Data-Analysis Metrics Library (DAML)
About DAML
The Data-Analysis Metrics Library, or DAML, focuses on characterizing image data and its impact on model performance across classification and object-detection tasks.
Model-agnostic metrics that bound real-world performance
- relevance/completeness/coverage
- metafeatures (data complexity)
Model-specific metrics that guide model selection and training
- dataset sufficiency
- data/model complexity mismatch
Metrics for post-deployment monitoring of data with bounds on model performance to guide retraining
- dataset-shift metrics
- model performance bounds under covariate shift
- guidance on sampling to assess model error and model retraining
Getting Started
Requirements
- Python 3.9-3.11
Installing DAML
You can install DAML directly from pypi.org using the following command. The optional dependencies of DAML are torch, tensorflow and all. Using torch enables Sufficiency metrics, and tensorflow enables OOD Detection.
pip install daml[all]
Installing DAML from GitHub
To install DAML from source locally on Ubuntu, you will need git-lfs to download larger, binary source files and poetry for project dependency management.
sudo apt-get install git-lfs
pip install poetry
Pull the source down and change to the DAML project directory.
git clone https://github.com/aria-ml/daml.git
cd daml
Install DAML with optional dependencies for development.
poetry install --all-extras --with dev
Now that DAML is installed, you can run commands in the poetry virtual environment by prefixing shell commands with poetry run, or activate the virtual environment directly in the shell.
poetry shell
Documentation and Tutorials
For more ideas on getting started using DAML in your workflow, additional information and tutorials are in our Sphinx documentation hosted on Read the Docs.
Attribution
This project uses code from the Alibi-Detect python library developed by SeldonIO. Additional documentation from the developers are also available here.
POCs
- POC: Scott Swan @scott.swan
- DPOC: Andrew Weng @aweng
1 maintainer
Metadata
1 maintainer
Release files for daml 0.56.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| daml-0.56.0.tar.gz | 61.4 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| daml-0.56.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 143.8 kB
Release files / daml-0.56.0.tar.gz
| Download URL | daml-0.56.0.tar.gz |
|---|---|
| Size | 61.4 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
c25181c1b1adcc6bb80d0fc0ef85196cba6396833b909762f9bcfc9b6723423a
|
|
BLAKE2b-256 checksum How to use checksums |
e9ca9d5d32b320f97438af18f85e3ff36c1b6bd9f34b9fb3051f19741cc3b4c1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/5.1.0 CPython/3.12.4
|
Release files / daml-0.56.0-py3-none-any.whl
| Download URL | daml-0.56.0-py3-none-any.whl |
|---|---|
| Size | 82.4 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
dfbce734c5cf9b7f57bfd69fb10a6cceb3ff3e79dffa31a6e373a61c8ff40db8
|
|
BLAKE2b-256 checksum How to use checksums |
a7b73b832368c38f84c93d15b6e96280ceba997e6bff8dc4b83aea56d67b8da4
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
twine/5.1.0 CPython/3.12.4
|
