🏋️♀️ Aporia Importer
A small utility to import ML production data from your cloud storage provider and monitor it using Aporia's monitoring platform.
Installation
pip install aporia-importer[all]
If you only wish to install the dependencies for a specific cloud provider, you can use
pip install aporia-importer[s3]
Usage
aporia-importer /path/to/config.yaml
aporia-importer requires a config file as a parameter, see configuration
Configuration
aporia-importer uses a YAML configuration file.
There are sample configurations in the examples directory.
Currently, the configuration requires defining a model version schema manually - the schema is a mapping of field names to field types (see here). You can find more details in our docs.
The following table describes all of the configuration fields in detail:
| Field | Required | Description |
|---|---|---|
| source | True | The path to the files you wish to upload, e.g. s3://my-bucket/my_file.csv. Glob patterns are supported. |
| format | True | The format of the files you wish to upload, see here |
| token | True | Your Aporia authentication token |
| environment | True | The environment in which Aporia will be initialized (e.g production, staging) |
| model_id | True | The ID of the model that the data is associated with |
| model_version.name | True | A name for the model version to create |
| model_version.type | True | The type of the model (regression, binary, multiclass) |
| predictions | True | A mapping of prediction fields to their field types |
| features | True | A mapping of feature fields to their field types |
| raw_inputs | False | A mapping of raw inputs fields to their field types |
| aporia_host | False | Aporia server URL. Defaults to app.aporia.com |
| aporia_port | False | Aporia server port. Defaults to 443 |
Supported Data Sources
- Local files
- S3
Supported Data Formats
- csv
- parquet
How does it work?
aporia-importer uses dask to load data from various cloud providers, and the Aporia sdk to report the data to Aporia.
1 maintainer
Metadata
1 maintainer
Release files for aporia-importer 1.0.6
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| aporia-importer-1.0.6.tar.gz | 5.5 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| aporia_importer-1.0.6-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 11.8 kB
Release files / aporia-importer-1.0.6.tar.gz
| Download URL | aporia-importer-1.0.6.tar.gz |
|---|---|
| Size | 5.5 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
34e7c5536dcbd65673fc93e9895e0feff64010567804af5ac7fca1b9434b3f14
|
|
BLAKE2b-256 checksum How to use checksums |
3c952b932acdcf1ec4bc56887b6fe93ded4673603f5e5182784c81cbea1933da
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.1.6 CPython/3.8.10 Linux/5.8.0-1033-azure
|
Release files / aporia_importer-1.0.6-py3-none-any.whl
| Download URL | aporia_importer-1.0.6-py3-none-any.whl |
|---|---|
| Size | 6.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
1c0cfd9aa66b97b44ca7c7f1b66382bd76f711a7bbf060cbd590332926b40110
|
|
BLAKE2b-256 checksum How to use checksums |
b2e0fe970c843029be9f559a3703d8e3e329c311c258af1f688d6121ddc5cc8d
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/1.1.6 CPython/3.8.10 Linux/5.8.0-1033-azure
|
