Skip to main content

Bird Feeder publishes Thredds metadata catalogs to a Solr index service with birdhouse schema.

Project description

Bird Feeder (the bird)

Feed the Birds …

Bird Feeder is parsing Thredds catalogs and local directories with NetCDF files and publishes metadata with download URLs to a Solr index service with a birdhouse schema.

Install from Anaconda

$ conda install -c birdhouse birdfeeder

Install from GitHub

$ git clone https://github.com/bird-house/bird-feeder.git
$ cd bird-feeder
$ make install

Start Solr service on http://localhost:8983/solr/birdhouse:

$ make start
$ make status

Using the command line

Help:

$ birdfeeder -h
usage: birdfeeder [<options>] <command> [<args>]

Feeds Solr with Datasets (NetCDF Format) from Thredds Catalogs and File
System.

optional arguments:
  -h, --help            show this help message and exit
  --debug               enable debug mode
  --service SERVICE     Solr URL. Default:
                        http://localhost:8983/solr/birdhouse
  --maxrecords MAXRECORDS
                        Maximum number of records to publish. Default: -1
                        (unlimited)
  --batch-size BATCH_SIZE
                        Batch size of records to publish. Default: 50000

command:
  List of available commands

  {clear,from-thredds,from-directory}
                     Run "birdfeeder <command> -h" to get additional help.
    clear               Clears the complete solr index. Use with caution!
    from-thredds        Publish datasets from Thredds Catalog to Solr.
    from-directory      Publish NetCDF files from directory to Solr.

Parse a Thredds catalog (recursively until depth level 2):

$ birdfeeder from-thredds --catalog-url http://example.com/thredds/catalog.xml --depth=2

Parse local NetCDF files:

$ birdfeeder from-directory --start-dir /home/data/myarchive

Authors

Carsten Ehbrecht ehbrecht at dkrz.de

Change History

0.1.1 (2015-07-28)

  • Initial Release.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

bird-feeder-0.1.1.tar.gz (5.7 kB view hashes)

Uploaded Source

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page