bird-feeder 0.1.2

Bird Feeder publishes Thredds metadata catalogs to a Solr index service with birdhouse schema.

Bird Feeder (the bird)

Feed the Birds …

Bird Feeder is parsing Thredds catalogs and local directories with NetCDF files and publishes metadata with download URLs to a Solr index service with a birdhouse schema.

Install from Anaconda

$ conda install -c birdhouse bird-feeder

Install from GitHub

$ git clone https://github.com/bird-house/bird-feeder.git
$ cd bird-feeder
$ make install

Start Solr service on http://localhost:8983/solr/birdhouse:

$ make start
$ make status

Using the command line

Help:

$ birdfeeder -h
usage: birdfeeder [<options>] <command> [<args>]

Feeds Solr with Datasets (NetCDF Format) from Thredds Catalogs and File
System.

optional arguments:
  -h, --help            show this help message and exit
  --debug               enable debug mode
  --service SERVICE     Solr URL. Default:
                        http://localhost:8983/solr/birdhouse
  --maxrecords MAXRECORDS
                        Maximum number of records to publish. Default: -1
                        (unlimited)
  --batch-size BATCH_SIZE
                        Batch size of records to publish. Default: 50000

command:
  List of available commands

  {clear,from-thredds,from-directory}
                     Run "birdfeeder <command> -h" to get additional help.
    clear               Clears the complete solr index. Use with caution!
    from-thredds        Publish datasets from Thredds Catalog to Solr.
    from-directory      Publish NetCDF files from directory to Solr.

Parse a Thredds catalog (recursively until depth level 2):

$ birdfeeder from-thredds --catalog-url http://example.com/thredds/catalog.xml --depth=2

Parse local NetCDF files:

$ birdfeeder from-directory --start-dir /home/data/myarchive

Authors

Carsten Ehbrecht ehbrecht at dkrz.de

Change History

0.1.2 (2015-09-18)

• Fixed #3: convert relative path to abs path for feeding from directory.

0.1.1 (2015-07-28)

• Initial Release.