No project description provided
Project description
Metis-Data
A set of utility functions and classes to aid in running jobs and libraries on a spark cluster, mostly on
the Databricks Platform, and targeted at AWS deployments.
TODO: This is a copy from the old jobworthy repo, and requires tons of updates to match the metis_data API.
Spark Job
- Spark Job
- Job Configuration
Util Module
- Spark Session
Repo Module
Repository Module
Schema Module
The Schema module provides functions for building a more abstract definition of a Hive table schema and abstractions for creating table, column and cell data which can be provided as the data argument when creating a dataframe.
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file metis_data-0.6.16.tar.gz.
File metadata
- Download URL: metis_data-0.6.16.tar.gz
- Upload date:
- Size: 33.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.2 CPython/3.11.6 Darwin/24.0.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
3616286cc11a596888acb18936b35fee028b3952fd82023d1b8578e28882f5b9
|
|
| MD5 |
722a16e5bebe498b258febbbb0478ca6
|
|
| BLAKE2b-256 |
4d0389c50b7d4c76ed992bdd2a6448c540f032b2184d5f0407244ac36ab167f0
|
File details
Details for the file metis_data-0.6.16-py3-none-any.whl.
File metadata
- Download URL: metis_data-0.6.16-py3-none-any.whl
- Upload date:
- Size: 43.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/1.8.2 CPython/3.11.6 Darwin/24.0.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
906a32d5c169ec7fc18b043317da8d720010ee878573e4ee8e66bd478793e758
|
|
| MD5 |
d0ac959a66785e9221f4ad0b78347cb0
|
|
| BLAKE2b-256 |
d863d93c6eb8243bb29cdd926b59a523b9487cdec33857b1bfcfbdd9dc42082b
|
