Skip to main content

OptHub Evaluator

OptHub Evaluator is a worker program that evaluates a solution submitted to OptHub.

Requirements

  • Python >=3.6
  • Docker >=1.12

See also requirements.txt for dependent python packages.

Installation

$ pip install opthub-evaluator

Usage

How to start an evaluator

Login the docker registry where the problem image is stored.

$ docker login <registry>

Start an evaluator.

$ opthub-evaluator

Options

Parameter Type Default Description
url path https://opthub-api.herokuapp.com/v1/graphql URL to OptHub
apikey str ApiKey
interval int 2 Polling interval
verify/no-verify bool True Verify SSL certificate
retries int 3 Retries to establish HTTPS connection
timeout int 600 Timeout to process a query
rm Remove containers after exit
quiet Be quieter
verbose Be more verbose
config path opthub-evaluator.yml Configuration file

How to make an problem image

  1. Write a problem program in your favorite language.
  2. Dockerize it.
  3. Push the docker image to DockerHub or somewhere else accessible from OptHub. For this purpose, OptHub hosts its own docker private registry.
  4. Register the image tag to OptHub.

See also example.

Author

Naoki Hamada (hmkz@s101.xrea.com)

License

MIT

Metadata

Release files for opthub-evaluator 0.8.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for opthub-evaluator 0.8.1
File Size Uploaded Provenance Actions
opthub-evaluator-0.8.1.tar.gz 9.7 kB Without provenance Details for opthub-evaluator-0.8.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for opthub-evaluator 0.8.1
File Interpreter ABI Platform Actions
opthub_evaluator-0.8.1-py3-none-any.whl Python 3 none any Details for opthub_evaluator-0.8.1-py3-none-any.whl

Total release size: 19.0 kB

Release files / opthub-evaluator-0.8.1.tar.gz

Download URL opthub-evaluator-0.8.1.tar.gz
Size 9.7 kB
Tags Source
SHA-256 checksum
How to use checksums
f4a099f8e435fbdd9aceca2059e4a0441541e658be28d7de60b2128a135187a6
BLAKE2b-256 checksum
How to use checksums
24efb07caf9df6984133e3b08fab2e9a6599efc14e5f0e61a2213dd82ea16bcc
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / opthub_evaluator-0.8.1-py3-none-any.whl

Download URL opthub_evaluator-0.8.1-py3-none-any.whl
Size 9.2 kB
Tags Python 3
SHA-256 checksum
How to use checksums
188acbe25a878aab0b5ca8b7f738a9ffb98e8a3b11fe1bdeaf6c58250a0cc5c0
BLAKE2b-256 checksum
How to use checksums
58f3dc96779e6d9aca621933925807d568506556a3e3bd2270fa5e0bc0126f26
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Security for opthub-evaluator 0.8.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page