No project description provided
Project description
Metis-Data
A set of utility functions and classes to aid in running jobs and libraries on a spark cluster, mostly on
the Databricks Platform, and targeted at AWS deployments.
TODO: This is a copy from the old jobworthy repo, and requires tons of updates to match the metis_data API.
Spark Job
- Spark Job
- Job Configuration
Util Module
- Spark Session
Repo Module
Repository Module
Schema Module
The Schema module provides functions for building a more abstract definition of a Hive table schema and abstractions for creating table, column and cell data which can be provided as the data argument when creating a dataframe.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
metis_data-0.6.7.tar.gz
(32.2 kB
view hashes)
Built Distribution
metis_data-0.6.7-py3-none-any.whl
(42.5 kB
view hashes)
Close
Hashes for metis_data-0.6.7-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 93be47678750a61c595b30cd4f7c6082dc57c60c9a4bf14ff8cff0850759d031 |
|
MD5 | 30a01873853456fc0a1be3b54531a45b |
|
BLAKE2b-256 | 431125402d2b82e7d4ab628c9c3165ec402cc9ad23b840c73aec9842320bda20 |