Skip to main content

Aggregation code for Zooniverse panoptes projects.

Project description

DOI Coverage Status

Getting started

This is a collection of external reducers written for caesar and offline use.


You can find the latest documentation on the aggregations code's website.

Installing for offline use

With your own python install (python 3 only)

Instal the latest stable release:

pip install panoptes_aggregation

Upgrade and existing installation:

pip install -U panoptes_aggregation

Or for development or testing, you can install the latest development version directly from GitHub:

pip install -U git+

Install the Graphical User Interface (GUI)

If you would like to use the GUI instead of the command line install the package with:

pip install "panoptes_aggregation[gui]"

Or for the latest development build from GitHub:

pip install -U git+[gui]

Anaconda build of python

If your are using the anaconda version of python some of the dependencies should be installed using the conda package manager before installing panoptes_aggregation:

conda install -c conda-forge python-levenshtein hdbscan
conda install wxpython psutil

Mac Anaconda build

If you are installing this code on a Mac using the anaconda build of python and you want to use the GUI instead of the command line you will have to update one line of the of code in the panoptes_aggregation_gui script. Change the first line from:



#!/bin/bash /path/to/anaconda/python/bin/

You can find the location of this file with the command:

which panoptes_aggregation_gui

You will also need to run:

conda install

With Docker

Using docker-compose

docker-compose -f docker-compose.local_scripts.yml build local_scripts

From the root directory of this repository, run the desired python scripts using the docker image, e.g. config_workflow_panoptes --help

docker-compose -f docker-compose.local_scripts.yml run --rm local_scripts panoptes_aggregation --help

Or directly via docker

docker build . -f Dockerfile.bin_cmds -t aggregation_for_caesar

From the root directory of this repository, run the desired python scripts using the docker image, e.g. panoptes_aggregation --help

docker run -it --rm --name config_workflow_panoptes -v "$PWD":/usr/src/aggregation aggregation_for_caesar panoptes_aggregation --help

Note The GUI does not work inside a docker container.

Installing for online use

The docker file included is ready to be deployed on any server. Once deployed, the extractors will be available on the /extractors/<name of extractor function> routes and the reducers will be available on the /reducers/<name of reducer function> routes. Any keywords passed into these functions should be included as url parameters on the route (e.g. For more complex keywords (e.g. detals for subtasks), python's urllib.parse.urlencode can be used to translate a keyword list into the proper url encoding.

The documentation will be built and available on the /docs route.

Build/run the app in docker locally

To run a local version use:

docker-compose build
docker-compose up

and listen on localhost:5000.

Running tests in the docker container

To run the tests use:

docker-compose run --rm aggregation nosetests

Project details

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

panoptes_aggregation-4.0.0.tar.gz (158.5 kB view hashes)

Uploaded Source

Built Distribution

panoptes_aggregation-4.0.0-py3-none-any.whl (255.2 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page