Skip to main content

This module is used to ecoshard sets of files.

Usage:

python -m ecoshard \[original\_file\] --hashalg md5 --rename

(creates an ecoshard from original file with the md5 hash algorithm and renames the result rather than creating a new copy)

python -m ecoshard *.tif --compress --buildoverviews

(does a GIS compression of all *.tif files in the current directory and builds overviews for them and renames the result rather than making a new copy. Here if –rename had been passed an error would have been raised because rasters cannot be in-place compressed. The target output files will have the format [original_filename]_compressed_[hashalg]_[ecoshard][fileext])

python -m ecoshard *.tif --compress --buildoverviews --upload

(does the previous operation but also uploads the results to gs://ecoshard-root/working-shards and reports the target URLs to stdout)

python -m ecoshard *.tif ./outputs/*.tif --validate

(searches the .tif and ./outputs/.tif globs for ecoshard files and reports whether their hashes are valid or not)

Release History

0.3.3 (2019/11/09)

  • Fixed an issue that would cause the download rate to be under estimated.

0.3.1 (2019/10/07)

  • Fixing an issue in download_to_url where the file might not be flushed and the final log message is not printed.

0.3.0 (2019/09/26)

  • Added a new command line mode –reduce_factor that reduces the number of pixels in a raster by that integer amount. Ex:

    python -m ecoshard base.tif --reduce_factor 4 max target.tif

    this call makes the size of the pixels in base.tif 4 times larger on the edge, thus reducing the total size of the image by 16 times, the convolution upsample is done with a “max” and the output file is target.tif. The modes “min”, “max”, “sum”, “average”, “mode” are available.

0.2.2 (2019/09/24)

  • Added a download_url function to ecoshard to fetch files via http(s).

  • Developing Flask module to visualize ecoshards.

0.2.1 (2019/06/28)

  • Hotfix: gs to gsutil for copying to buckets.

0.2.0 (2019/06/28)

  • Added functionality to download a url.

  • Added functionality to copy to a google bucket.

  • Fixed an issue on functions that should write a token file but didn’t.

0.1.1 (2019/06/27)

  • Added a --force flag to the command line utility.

0.0.2 (2019/06/26)

  • Initial release.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ecoshard-0.3.3.tar.gz (12.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ecoshard-0.3.3-py3-none-any.whl (10.7 kB view details)

Uploaded Python 3

File details

Details for the file ecoshard-0.3.3.tar.gz.

File metadata

  • Download URL: ecoshard-0.3.3.tar.gz
  • Upload date:
  • Size: 12.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.4

File hashes

Hashes for ecoshard-0.3.3.tar.gz
Algorithm Hash digest
SHA256 e17834f67e095fed22c6ba374257599595589f936d6c9a74e9e073da8d7e5c93
MD5 24a2ca9227af8b5d85d88b46e22b1888
BLAKE2b-256 1bb2c0adae8b985b834738764b50e5a241517fb3fe62fcc565b94b5a9b814f36

See more details on using hashes here.

File details

Details for the file ecoshard-0.3.3-py3-none-any.whl.

File metadata

  • Download URL: ecoshard-0.3.3-py3-none-any.whl
  • Upload date:
  • Size: 10.7 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.4

File hashes

Hashes for ecoshard-0.3.3-py3-none-any.whl
Algorithm Hash digest
SHA256 f8813bcaf7a4aa34c31888ae63f15fcda722ac4fae0c8e4cb31d407e110c4cee
MD5 e036325d644ea70c1155436ef2916e89
BLAKE2b-256 8323e4ecd1e67641d45bc309bd1b1e250b514111a8f53f4fdd008510cd4bbc9f

See more details on using hashes here.

Release history Release notifications | RSS feed

0.7.0

1 file

0.6.0

1 file

0.5.0

3 files

0.4.1

1 file

0.4.0

2 files

This release

0.3.3 This release

2 files

0.3.2

2 files

0.3.1

1 file

0.3.0

1 file

0.2.2

1 file

0.2.1

2 files

0.2.0

2 files

0.1.1

2 files

0.0.2

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page