This module is used to ecoshard sets of files.
Usage:
python -m ecoshard \[original\_file\] --hashalg md5 --rename
(creates an ecoshard from original file with the md5 hash algorithm and renames the result rather than creating a new copy)
python -m ecoshard *.tif --compress --buildoverviews
(does a GIS compression of all *.tif files in the current directory and builds overviews for them and renames the result rather than making a new copy. Here if –rename had been passed an error would have been raised because rasters cannot be in-place compressed. The target output files will have the format [original_filename]_compressed_[hashalg]_[ecoshard][fileext])
python -m ecoshard *.tif --compress --buildoverviews --upload
(does the previous operation but also uploads the results to gs://ecoshard-root/working-shards and reports the target URLs to stdout)
python -m ecoshard *.tif ./outputs/*.tif --validate
(searches the .tif and ./outputs/.tif globs for ecoshard files and reports whether their hashes are valid or not)
Release History
Unreleased Changes
Fixed an issue that would cause the download rate to be under estimated.
0.3.1 (2019/10/07)
Fixing an issue in download_to_url where the file might not be flushed and the final log message is not printed.
0.3.0 (2019/09/26)
Added a new command line mode –reduce_factor that reduces the number of pixels in a raster by that integer amount. Ex:
python -m ecoshard base.tif --reduce_factor 4 max target.tif
this call makes the size of the pixels in base.tif 4 times larger on the edge, thus reducing the total size of the image by 16 times, the convolution upsample is done with a “max” and the output file is target.tif. The modes “min”, “max”, “sum”, “average”, “mode” are available.
0.2.2 (2019/09/24)
Added a download_url function to ecoshard to fetch files via http(s).
Developing Flask module to visualize ecoshards.
0.2.1 (2019/06/28)
Hotfix: gs to gsutil for copying to buckets.
0.2.0 (2019/06/28)
Added functionality to download a url.
Added functionality to copy to a google bucket.
Fixed an issue on functions that should write a token file but didn’t.
0.1.1 (2019/06/27)
Added a --force flag to the command line utility.
0.0.2 (2019/06/26)
Initial release.
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file ecoshard-0.3.2.tar.gz.
File metadata
- Download URL: ecoshard-0.3.2.tar.gz
- Upload date:
- Size: 12.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
eb1b0101517fa6d2c6667c049c8354af2ca9f51dadc1921013c7dc25e49a7dab
|
|
| MD5 |
8a733ce0260cfea13f2a55380c0bcf44
|
|
| BLAKE2b-256 |
4b1366bab968bc6abad63270da8004c8fcd7d868ea6024c55aa930a0a6ff1e04
|
File details
Details for the file ecoshard-0.3.2-py3-none-any.whl.
File metadata
- Download URL: ecoshard-0.3.2-py3-none-any.whl
- Upload date:
- Size: 10.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/2.0.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.6.0 requests-toolbelt/0.9.1 tqdm/4.38.0 CPython/3.7.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
7585872729416057572dae94642cf0348d380c826bde48115cbd9920074b7c1c
|
|
| MD5 |
ebb8d21a1b84d4d362f58beaba7f35e2
|
|
| BLAKE2b-256 |
7a8f1241a540a1f8606490af8b0fe3037782b48d0ab6d90dff989c38e9256d4b
|
