Skip to main content

This module is used to ecoshard sets of files.

Usage:

python -m ecoshard \[original\_file\] --hashalg md5 --rename

(creates an ecoshard from original file with the md5 hash algorithm and renames the result rather than creating a new copy)

python -m ecoshard *.tif --compress --buildoverviews

(does a GIS compression of all *.tif files in the current directory and builds overviews for them and renames the result rather than making a new copy. Here if –rename had been passed an error would have been raised because rasters cannot be in-place compressed. The target output files will have the format [original_filename]_compressed_[hashalg]_[ecoshard][fileext])

python -m ecoshard *.tif --compress --buildoverviews --upload

(does the previous operation but also uploads the results to gs://ecoshard-root/working-shards and reports the target URLs to stdout)

python -m ecoshard *.tif ./outputs/*.tif --validate

(searches the .tif and ./outputs/.tif globs for ecoshard files and reports whether their hashes are valid or not)

Release History

0.3.1 (2019/10/07)

  • Fixing an issue in download_to_url where the file might not be flushed and the final log message is not printed.

0.3.0 (2019/09/26)

  • Added a new command line mode –reduce_factor that reduces the number of pixels in a raster by that integer amount. Ex:

    python -m ecoshard base.tif --reduce_factor 4 max target.tif

    this call makes the size of the pixels in base.tif 4 times larger on the edge, thus reducing the total size of the image by 16 times, the convolution upsample is done with a “max” and the output file is target.tif. The modes “min”, “max”, “sum”, “average”, “mode” are available.

0.2.2 (2019/09/24)

  • Added a download_url function to ecoshard to fetch files via http(s).

  • Developing Flask module to visualize ecoshards.

0.2.1 (2019/06/28)

  • Hotfix: gs to gsutil for copying to buckets.

0.2.0 (2019/06/28)

  • Added functionality to download a url.

  • Added functionality to copy to a google bucket.

  • Fixed an issue on functions that should write a token file but didn’t.

0.1.1 (2019/06/27)

  • Added a --force flag to the command line utility.

0.0.2 (2019/06/26)

  • Initial release.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distributions

No source distribution files available for this release.See tutorial on generating distribution archives.

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

ecoshard-0.3.1-py3-none-any.whl (12.6 kB view details)

Uploaded Python 3

File details

Details for the file ecoshard-0.3.1-py3-none-any.whl.

File metadata

  • Download URL: ecoshard-0.3.1-py3-none-any.whl
  • Upload date:
  • Size: 12.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.33.0 CPython/3.7.4

File hashes

Hashes for ecoshard-0.3.1-py3-none-any.whl
Algorithm Hash digest
SHA256 5a6580bbf4f1ff3506b3bcbb977336fac896468b266ac4abd8367c4eedb3475f
MD5 f997b8a9b35f8ec72243bd79bb22e145
BLAKE2b-256 7acb508464d7c3c40f7b0b374c8fb45ac7b5d9a15415b147bf64e332b81f58f7

See more details on using hashes here.

Release history Release notifications | RSS feed

0.7.0

1 file

0.6.0

1 file

0.5.0

3 files

0.4.1

1 file

0.4.0

2 files

0.3.3

2 files

0.3.2

2 files

This release

0.3.1 This release

1 file

0.3.0

1 file

0.2.2

1 file

0.2.1

2 files

0.2.0

2 files

0.1.1

2 files

0.0.2

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page