OLMo-in-loop-evals
Code for in-loop evaluation tasks used by the OLMo training team.
Installation
pip install ai2-olmo-eval
Release process
Steps
-
Update the version in
src/olmo_eval/version.py. -
Run the release script:
./src/scripts/release.sh
This will commit the changes to the CHANGELOG and
version.pyfiles and then create a new tag in git which will trigger a workflow on GitHub Actions that handles the rest.
Fixing a failed release
If for some reason the GitHub Actions release workflow failed with an error that needs to be fixed, you'll have to delete the tag on GitHub. Once you've pushed a fix you can simply repeat the steps above.
1 maintainer
Metadata
1 maintainer
Release files for ai2-olmo-eval 0.9.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| ai2_olmo_eval-0.9.0.tar.gz | 85.3 MB | Without provenance | Details for ai2_olmo_eval-0.9.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| ai2_olmo_eval-0.9.0-py3-none-any.whl | Python 3 | none | any | Details for ai2_olmo_eval-0.9.0-py3-none-any.whl |
Total release size: 170.9 MB
Release files / ai2_olmo_eval-0.9.0.tar.gz
| Download URL | ai2_olmo_eval-0.9.0.tar.gz |
|---|---|
| Size | 85.3 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
a36d1210b921aabfbcefc3ecb704a7ac25adf25ae91f1c86343eff2bc142c6cb
|
|
BLAKE2b-256 checksum How to use checksums |
29d4019f23e572ffe26afb1607e2e2a82d3f1606d9154136381738489d157d4c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.19
|
Release files / ai2_olmo_eval-0.9.0-py3-none-any.whl
| Download URL | ai2_olmo_eval-0.9.0-py3-none-any.whl |
|---|---|
| Size | 85.6 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
61b08ab60ca5b4d175f78c8da95c362c1d745b1502b87de01f437fac768e1cbe
|
|
BLAKE2b-256 checksum How to use checksums |
1667b7307cb86a5d46d34d39461c1232544c7ae4e575a12fd55cde866355399f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.10.19
|
Security for ai2-olmo-eval 0.9.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.
