Bird Feeder publishes Thredds metadata catalogs to a Solr index service with birdhouse schema.
Project description
- Bird Feeder (the bird)
- Feed the Birds …
Bird Feeder is parsing Thredds catalogs and local directories with NetCDF files and publishes metadata with download URLs to a Solr index service with a birdhouse schema.
Install from Anaconda
$ conda install -c birdhouse bird-feeder
Install from GitHub
$ git clone https://github.com/bird-house/bird-feeder.git
$ cd bird-feeder
$ make install
Start Solr service on http://localhost:8983/solr/birdhouse:
$ make start $ make status
Using the command line
Help:
$ birdfeeder -h usage: birdfeeder [<options>] <command> [<args>] Feeds Solr with Datasets (NetCDF Format) from Thredds Catalogs and File System. optional arguments: -h, --help show this help message and exit --debug enable debug mode --service SERVICE Solr URL. Default: http://localhost:8983/solr/birdhouse --maxrecords MAXRECORDS Maximum number of records to publish. Default: -1 (unlimited) --batch-size BATCH_SIZE Batch size of records to publish. Default: 50000 command: List of available commands {clear,from-thredds,from-directory} Run "birdfeeder <command> -h" to get additional help. clear Clears the complete solr index. Use with caution! from-thredds Publish datasets from Thredds Catalog to Solr. from-directory Publish NetCDF files from directory to Solr.
Parse a Thredds catalog (recursively until depth level 2):
$ birdfeeder from-thredds --catalog-url http://example.com/thredds/catalog.xml --depth=2
Parse local NetCDF files:
$ birdfeeder from-directory --start-dir /home/data/myarchive
Authors
Carsten Ehbrecht ehbrecht at dkrz.de
Change History
0.1.2 (2015-09-18)
- Fixed #3: convert relative path to abs path for feeding from directory.
0.1.1 (2015-07-28)
- Initial Release.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
bird-feeder-0.1.2.tar.gz
(6.0 kB
view hashes)