No project description provided
Project description
Metis-Data
A set of utility functions and classes to aid in running jobs and libraries on a spark cluster, mostly on
the Databricks Platform, and targeted at AWS deployments.
TODO: This is a copy from the old jobworthy repo, and requires tons of updates to match the metis_data API.
Spark Job
- Spark Job
- Job Configuration
Util Module
- Spark Session
Repo Module
Repository Module
Schema Module
The Schema module provides functions for building a more abstract definition of a Hive table schema and abstractions for creating table, column and cell data which can be provided as the data argument when creating a dataframe.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
metis_data-0.6.15.tar.gz
(33.2 kB
view details)
Built Distribution
File details
Details for the file metis_data-0.6.15.tar.gz.
File metadata
- Download URL: metis_data-0.6.15.tar.gz
- Upload date:
- Size: 33.2 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.2 CPython/3.11.6 Darwin/24.0.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 71fbcfe1e54ddce4653c1936f701fe0f4e9129f7e7ecbf2c9a2bde769d7a6bcf |
|
| MD5 | b57d6293e04c5a67b11afdaab5e7d6ca |
|
| BLAKE2b-256 | 51c058542763581b1c6bd6951ad6889bf245ae84ea82327029b715a026fe1936 |
File details
Details for the file metis_data-0.6.15-py3-none-any.whl.
File metadata
- Download URL: metis_data-0.6.15-py3-none-any.whl
- Upload date:
- Size: 43.7 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.2 CPython/3.11.6 Darwin/24.0.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 | 2601994a03f7de690b50013647d2ec348a1becab5dbce495b735ee2574f25af0 |
|
| MD5 | 2cb0aa051a3beaee8b52b5300dfc8b55 |
|
| BLAKE2b-256 | 6f7197ffe200218c658dcc9f6e6d6998e517de194bc121ad16f730a8c111c7d4 |
