Skip to main content

This module is used to ecoshard sets of files.

Usage:

python -m ecoshard \[original\_file\] --hashalg md5 --rename

(creates an ecoshard from original file with the md5 hash algorithm and renames the result rather than creating a new copy)

python -m ecoshard *.tif --compress --buildoverviews

(does a GIS compression of all *.tif files in the current directory and builds overviews for them and renames the result rather than making a new copy. Here if –rename had been passed an error would have been raised because rasters cannot be in-place compressed. The target output files will have the format [original_filename]_compressed_[hashalg]_[ecoshard][fileext])

python -m ecoshard *.tif --compress --buildoverviews --upload

(does the previous operation but also uploads the results to gs://ecoshard-root/working-shards and reports the target URLs to stdout)

python -m ecoshard *.tif ./outputs/*.tif --validate

(searches the .tif and ./outputs/.tif globs for ecoshard files and reports whether their hashes are valid or not)

Release History

0.3.0 (2019/09/26)

  • Added a new command line mode –reduce_factor that reduces the number of pixels in a raster by that integer amount. Ex:

    python -m ecoshard base.tif --reduce_factor 4 max target.tif

    this call makes the size of the pixels in base.tif 4 times larger on the edge, thus reducing the total size of the image by 16 times, the convolution upsample is done with a “max” and the output file is target.tif. The modes “min”, “max”, “sum”, “average”, “mode” are available.

0.2.2 (2019/09/24)

  • Added a download_url function to ecoshard to fetch files via http(s).

  • Developing Flask module to visualize ecoshards.

0.2.1 (2019/06/28)

  • Hotfix: gs to gsutil for copying to buckets.

0.2.0 (2019/06/28)

  • Added functionality to download a url.

  • Added functionality to copy to a google bucket.

  • Fixed an issue on functions that should write a token file but didn’t.

0.1.1 (2019/06/27)

  • Added a --force flag to the command line utility.

0.0.2 (2019/06/26)

  • Initial release.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

ecoshard-0.3.0.tar.gz (18.3 kB view details)

Uploaded Source

File details

Details for the file ecoshard-0.3.0.tar.gz.

File metadata

  • Download URL: ecoshard-0.3.0.tar.gz
  • Upload date:
  • Size: 18.3 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.33.0 CPython/3.7.4

File hashes

Hashes for ecoshard-0.3.0.tar.gz
Algorithm Hash digest
SHA256 3b0a1b3afa774337429bf8554809ece426d3c32a9e624dea88b462adbdda6da1
MD5 422ea556c79b88ca7e0c3e4b0c866cbe
BLAKE2b-256 3ff6c74cb1e833b0d41104d6a7acbc8ef1d46cfb4a0255eb0c106d00163bdc39

See more details on using hashes here.

Release history Release notifications | RSS feed

0.7.0

1 file

0.6.0

1 file

0.5.0

3 files

0.4.1

1 file

0.4.0

2 files

0.3.3

2 files

0.3.2

2 files

0.3.1

1 file

This release

0.3.0 This release

1 file

0.2.2

1 file

0.2.1

2 files

0.2.0

2 files

0.1.1

2 files

0.0.2

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page