No project description provided
Project description
focus_converter_base
This project impelemnts a set of common functions that can be used to convert provider specific cost data into FOCUS specification cost dataset.
It implements a variety of transform functions that take advantage of polars lazy load API(s) allowing up to compute large datasets without fitting everything into memory.
Another important technology here is the pyarrow's dataset scanner that make it possible to read data into smaller chunks that can be processed out of memory.
Also, the reference implementation uses an abstraction layer called fsspec, which abstracts reading writing from object stores like S3, GCS etc.
Installation, etc.
For general installation instructions and development guidance, please see the parent README.md.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for focus_converter-0.7.1.dev2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | bedaf1ea2f1494a94024644ef437bfc179853d84f0f2296a7115d69f426623d6 |
|
MD5 | 4bc244e27e5711f7f113c22255b21279 |
|
BLAKE2b-256 | 5b2f58f36ded8b60d2f6d1829fcd2e959631e4fa6244e568a81eb96012648424 |
Hashes for focus_converter-0.7.1.dev2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6a7bc65ae3054840ebfc80757d3d14bc938abdf2bae3a97af80bc2576be62e34 |
|
MD5 | 29e0d84dc5f9234211d79aa7833bcdf3 |
|
BLAKE2b-256 | 7fb222f3b51306e060ce887f1a985e33a57e894d3ba8fe80dbc68c049dabca89 |