Core training module for the Open Language Model (OLMo)
Project description
OLMo-core
Building blocks for OLMo modeling and training
Examples || Docs || PyPI || Beaker Images || License || Changelog
Installation
First install PyTorch according to the instructions specific to your operating system. Then you can install from PyPI with:
pip install ai2-olmo-core
Development
After cloning OLMo-core and setting up a Python virtual environment, install the codebase from source with:
pip install -e .[all]
The Python library source code is located in src/olmo_core
. The corresponding tests are located in src/test
. The library docs are located in docs
. You can build the docs locally with make docs
.
Code checks:
- We use
pytest
to run tests. You can run all tests withpytest -v src/test
. You can also pointpytest
at a specific test file to run it individually. - We use
isort
andblack
for code formatting. Ideally you should integrate these into your editor, but you can also run them manually or configure them with a pre-commit hook. To validate that all files are formatted correctly, runmake style-check
. - We use
ruff
as our primary linter. You can run it withmake lint-check
. - We use
mypy
as our type checker. You can run it withmake type-check
.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
ai2_olmo_core-1.0.3.tar.gz
(96.8 kB
view hashes)
Built Distribution
ai2_olmo_core-1.0.3-py3-none-any.whl
(117.6 kB
view hashes)
Close
Hashes for ai2_olmo_core-1.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | e469c0f88b6e8aa3d9c9365549f516d1f1a419202e0e6e39dd49fff00c4f17c9 |
|
MD5 | 2d658967423498d614c82f483be6e86f |
|
BLAKE2b-256 | 9b6cb2c569b66370868e8e2ae407fec409fc1c631261d9033b9c28b507b70553 |