Kedro starters by GetInData
In GetInData we deploy Kedro-based projects to different environments (on-premise and cloud). This repository hosts the starters with a few deployment recipes, including the ones that use our plugins.
Available starters
- pyspark-iris-running-on-gke uses Google Kubernetes Engine to run Spark-powered kedro pipeline in a distributed manner.
- pyspark-iris-running-on-gcp-dataproc-serverless uses Google Cloud Dataproc Batches to run Spark-powered kedro pipeline in a distributed manner on Severless Spark.
Starters development
- Clone the repository and switch to
develop - Run
poetry install - Run
source $(poetry env info --path)/bin/activateNote: when you useconda, you need the extra step ofconda deactivateto avoid conflict between thecondaandvenv - Install kedro
pip install kedro==0.18.3 - Run
kedro new -s <name-of-the-starter>
Metadata
Release files for getindata-kedro-starters 0.2.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| getindata_kedro_starters-0.2.0.tar.gz | 161.0 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| getindata_kedro_starters-0.2.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 357.3 kB
Release files / getindata_kedro_starters-0.2.0.tar.gz
| Download URL | getindata_kedro_starters-0.2.0.tar.gz |
|---|---|
| Size | 161.0 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
239ecdbc11fdac33037c49ba725e5d23711ecfdbbc1dc16a7829e2e0494ef439
|
|
BLAKE2b-256 checksum How to use checksums |
3aced8e6c1604cbe15d5ffe8b736f6d4b5e05d6e84e484d699f4f1826a7cdd79
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.9.16
|
Release files / getindata_kedro_starters-0.2.0-py3-none-any.whl
| Download URL | getindata_kedro_starters-0.2.0-py3-none-any.whl |
|---|---|
| Size | 196.3 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
7e7fb1293aa0ea6a98e1173e8594280fd13937f042d268a588d55576a4b9d833
|
|
BLAKE2b-256 checksum How to use checksums |
2878e1665a9b2a1c320bfffb5a4f661a701c3b29bccbcf6edf32f9f67e5d35dc
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.9.16
|