Composable Query Meta Language
Project description
cqml
Composable Query Meta Language
CQML is declarative data format for specifying complete data analysis pipelines. It is most commonly implemented as YAML, but can trivially be transformed into JSON, CSON, or macOS and Java property lists.
The initial back-end is written for the DataBrick's flavor of PySpark and Spark SQL, but should be easy to extend to other databases and warehouses.
USAGE
#pip install git+https://github.com/TheSwanFactory/cqml.git@main #@v3-daily
pip install cqml #==0.3.0
import cqml
Testing
From top-level directory:
$ python3 -m pip install -r requirements.txt
$ pip install pytest
$ python3 -m pytest
Building the Packages
$ python3 -m pip install --upgrade build
$ python3 -m pip install --upgrade twine
$ prerelease && release && python3 -m build && python3 -m twine upload dist/* && postrelease
Development Build
awk -Fv '{printf("%sv%d\n",$1,v$2+1)}' version.txt > /tmp/version.txt && cp /tmp/version.txt version.txt && git commit -a && git push
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
cqml-0.3.4.tar.gz
(21.3 kB
view details)
Built Distribution
cqml-0.3.4-py3-none-any.whl
(16.1 kB
view details)
File details
Details for the file cqml-0.3.4.tar.gz
.
File metadata
- Download URL: cqml-0.3.4.tar.gz
- Upload date:
- Size: 21.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.10.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7041f3dd5e60979ac965f9b7f7e8c0be5a1e02b5668a90eadd66212931fdd758 |
|
MD5 | 85fd673d3930c80739e86b17967c2e85 |
|
BLAKE2b-256 | 4e579037334fd4e47822e0e1b1692462dacc19638c41bc0bd307bcb49f85c4d4 |
File details
Details for the file cqml-0.3.4-py3-none-any.whl
.
File metadata
- Download URL: cqml-0.3.4-py3-none-any.whl
- Upload date:
- Size: 16.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.8.0 pkginfo/1.8.2 readme-renderer/32.0 requests/2.27.1 requests-toolbelt/0.9.1 urllib3/1.26.8 tqdm/4.63.0 importlib-metadata/4.11.1 keyring/23.5.0 rfc3986/2.0.0 colorama/0.4.4 CPython/3.10.2
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 587a3ec1bac7462af95f45c41831f6ff9c315d3326c24858297f25694ad39c77 |
|
MD5 | e09c280397f9389d3afd1651cb9d2d8f |
|
BLAKE2b-256 | 2a0bc568d0a1491873929901cf84a707fc992169ace028f4cc8e0042dee5e555 |