FireSpark
FireSpark aims to provide Magna ML/MAS team a flexible and standardized library supporting data processing, management, dataset curation, and ETL related activities.
A dataset created using FireSpark is stored in Apache Parquet format. On top of a Parquet schema, FireSpark takes advantage of open source Petastorm library to support multidimensional arrays.
This repo is at its early phase development stage. Please contact me if you have question, especially on contributing use case specification, requirements, suggestions. :innocent:
1 maintainer
Metadata
1 maintainer
Release files for FireSpark 0.0.32
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| FireSpark-0.0.32.tar.gz | 324.2 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| FireSpark-0.0.32-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 859.9 kB
Release files / FireSpark-0.0.32.tar.gz
| Download URL | FireSpark-0.0.32.tar.gz |
|---|---|
| Size | 324.2 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
386d2a411c3c714b52a6a50428d4874867f965d0a181295a0b58c50b0b17c7f3
|
|
BLAKE2b-256 checksum How to use checksums |
2606b2466e8c01e47cdf9837506c60810cb6c325d07fcdf5e2d8e57840241b81
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.7.4
|
Release files / FireSpark-0.0.32-py3-none-any.whl
| Download URL | FireSpark-0.0.32-py3-none-any.whl |
|---|---|
| Size | 535.7 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
ed728ccbe9c4fcf7452d75894346c4241a7ac0302a2f0c802e69b5587a7ac97a
|
|
BLAKE2b-256 checksum How to use checksums |
673837e1d2fcdc0c357f478d3aaa95f4b408bc57ea8752a0aee63302890a18b6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.4.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.7.4
|
