Skip to main content

No project description provided

Project description

focus_converter_base

This project impelemnts a set of common functions that can be used to convert provider specific cost data into FOCUS specification cost dataset.

It implements a variety of transform functions that take advantage of polars lazy load API(s) allowing up to compute large datasets without fitting everything into memory.

Another important technology here is the pyarrow's dataset scanner that make it possible to read data into smaller chunks that can be processed out of memory.

Also, the reference implementation uses an abstraction layer called fsspec, which abstracts reading writing from object stores like S3, GCS etc.

Installation, etc.

For general installation instructions and development guidance, please see the parent README.md.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

focus_converter-0.7.1.dev1.tar.gz (29.3 kB view hashes)

Uploaded Source

Built Distribution

focus_converter-0.7.1.dev1-py3-none-any.whl (74.4 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page