Skip to main content

Bird Feeder publishes Thredds metadata catalogs to a Solr index service with birdhouse schema.

Project description

Travis Build
Bird Feeder (the bird)
Feed the Birds …

Bird Feeder is parsing Thredds catalogs and local directories with NetCDF files and publishes metadata with download URLs to a Solr index service with a birdhouse schema.

Install from Anaconda

Anaconda Build Anaconda Version Anaconda Downloads
$ conda install -c birdhouse bird-feeder

Install from GitHub

$ git clone https://github.com/bird-house/bird-feeder.git
$ cd bird-feeder
$ make install

Start Solr service on http://localhost:8983/solr/birdhouse:

$ make start
$ make status

Using the command line

Help:

$ birdfeeder -h
usage: birdfeeder [<options>] <command> [<args>]

Feeds Solr with Datasets (NetCDF Format) from Thredds Catalogs and File
System.

optional arguments:
  -h, --help            show this help message and exit
  --debug               enable debug mode
  --service SERVICE     Solr URL. Default:
                        http://localhost:8983/solr/birdhouse
  --maxrecords MAXRECORDS
                        Maximum number of records to publish. Default: -1
                        (unlimited)
  --batch-size BATCH_SIZE
                        Batch size of records to publish. Default: 50000

command:
  List of available commands

  {clear,from-thredds,from-directory}
                     Run "birdfeeder <command> -h" to get additional help.
    clear               Clears the complete solr index. Use with caution!
    from-thredds        Publish datasets from Thredds Catalog to Solr.
    from-directory      Publish NetCDF files from directory to Solr.

Parse a Thredds catalog (recursively until depth level 2):

$ birdfeeder from-thredds --catalog-url http://example.com/thredds/catalog.xml --depth=2

Parse local NetCDF files:

$ birdfeeder from-directory --start-dir /home/data/myarchive

Authors

Carsten Ehbrecht ehbrecht at dkrz.de

Change History

0.1.2 (2015-09-18)

  • Fixed #3: convert relative path to abs path for feeding from directory.

0.1.1 (2015-07-28)

  • Initial Release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for bird-feeder, version 0.1.2
Filename, size File type Python version Upload date Hashes
Filename, size bird-feeder-0.1.2.tar.gz (6.0 kB) File type Source Python version None Upload date Hashes View

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring DigiCert DigiCert EV certificate Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page