A Fast, Declarative ETL for Graph Databases.
Project description
Nodestream
A Declarative framework for Building, Maintaining, and Analyzing Graph Data 🚀
Nodestream allows you to work with graphs declaratively. With nodestream, you unlock a bounty of features purpose built for working with graphs. Semantically model your graph and map labels and properties directly to your data. Better yet, you are not locked into your choices. Nodestream works with you as you evolve your application by providing migration utilities to change your data schema. Nodestream even decouples you from the underyling database technology so you can even change databases.
Highlights
- Connect to data sources like Kafka, files, apis, and more!
- Evolve your application over time with database migrations (Docs)
- Use your favorite Graph Database to fit any tech stack (Docs)
- Clean up your own data with TTLs (Docs)
- Infinite Customizability Since Nearly Everything is Pluggable!
Website • Blog • Discussions • Contributing • Contributing Developer Guides • Talks from Maintainers
Features
Nodestream has a pleasant CLI interface to get new projects up and running fast.
Not a fan of the defaults? You can change out databases very easily
Then you can start to model your data and nodestream will evolve your database for you. No more messing with constraints or writing database queries.
Getting Started
Conviced? Install nodestream with pip to get started.
pip install nodestream
nodestream new --database neo4j my_project && cd my_project
nodestream run sample -v
We highly recommend following our tutorials here
Packages
Nodestream is built on a Highly Pluggable and Modular Architecture. Thus... we have a lot of packages to keep track of.
| Package | Description | Version |
|---|---|---|
nodestream |
The core library. Declarative ingestion. |  |
nodestream-plugin-neo4j |
Neo4j database connector. |  |
nodestream-plugin-neptune |
AWS Neptune database connector. |  |
nodestream-plugin-dotenv |
Adds DotEnv integration. |  |
nodestream-plugin-pedantic |
A series of lints to enforce reasonable naming standards, etc. |  |
nodestream-plugin-shell |
An integration with nodestream to run shell commands. |  |
nodestream-plugin-sbom |
Import SBOM files in CycloneDX and SPDX into an opinionated graph data model. |  |
nodestream-plugin-akamai |
Parse Akamai properties, redirect configs, and much more and ingests them. |  |
nodestream-plugin-k8s |
In incubation. A plugin that orchestrates Nodestream on k8s. |  |
Contributors
Nodestream is a community project. We welcome all contributions. Be sure to checkout or Contributing Docs and our Code of Conduct before contributing.
Contributing
Need a quick reference guide on how to contribute? Here you go!
Getting Setup
To get started you'll need to install poery.
curl -sSL https://install.python-poetry.org | python3 -
You then can install the project dependencies with the following command:
poetry install
No need to active a virtual environment. Poetry handles that for you with poetry run and poetry shell.
Running Tests
To run tests for the entire project, run the following command:
poetry run pytest
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file nodestream-0.14.17.tar.gz.
File metadata
- Download URL: nodestream-0.14.17.tar.gz
- Upload date:
- Size: 112.5 kB
- Tags: Source
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
36148e46f3a111f8868d80824559825ee987e3aa8fa3809461cce8b374aae038
|
|
| MD5 |
eb47fb48745581058ff6756a3bdf9ecb
|
|
| BLAKE2b-256 |
73a83163fc8e2252de00066005dfec8a1a16239b0e859f9ad20c53fb75b01e14
|
Provenance
The following attestation bundles were made for nodestream-0.14.17.tar.gz:
Publisher:
release.yaml on nodestream-proj/nodestream
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
nodestream-0.14.17.tar.gz -
Subject digest:
36148e46f3a111f8868d80824559825ee987e3aa8fa3809461cce8b374aae038 - Sigstore transparency entry: 595225544
- Sigstore integration time:
-
Permalink:
nodestream-proj/nodestream@0f0a2e68572aa959f1e0a08dbf2a5c5e6ff5dd0c -
Branch / Tag:
refs/tags/v0.14.17 - Owner: https://github.com/nodestream-proj
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yaml@0f0a2e68572aa959f1e0a08dbf2a5c5e6ff5dd0c -
Trigger Event:
release
-
Statement type:
File details
Details for the file nodestream-0.14.17-py3-none-any.whl.
File metadata
- Download URL: nodestream-0.14.17-py3-none-any.whl
- Upload date:
- Size: 172.3 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? Yes
- Uploaded via: twine/6.1.0 CPython/3.13.7
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
4387486a4b7242c72f669b206e6c12db5ae88b133617800abd48794d4f76ed44
|
|
| MD5 |
e6d5c05fd24162cd05c42cd076d532a8
|
|
| BLAKE2b-256 |
9384888f4a18356bf355b867ae213ce17aeee98f7ce0b84e8c8e4651f3845a9d
|
Provenance
The following attestation bundles were made for nodestream-0.14.17-py3-none-any.whl:
Publisher:
release.yaml on nodestream-proj/nodestream
-
Statement:
-
Statement type:
https://in-toto.io/Statement/v1 -
Predicate type:
https://docs.pypi.org/attestations/publish/v1 -
Subject name:
nodestream-0.14.17-py3-none-any.whl -
Subject digest:
4387486a4b7242c72f669b206e6c12db5ae88b133617800abd48794d4f76ed44 - Sigstore transparency entry: 595225566
- Sigstore integration time:
-
Permalink:
nodestream-proj/nodestream@0f0a2e68572aa959f1e0a08dbf2a5c5e6ff5dd0c -
Branch / Tag:
refs/tags/v0.14.17 - Owner: https://github.com/nodestream-proj
-
Access:
public
-
Token Issuer:
https://token.actions.githubusercontent.com -
Runner Environment:
github-hosted -
Publication workflow:
release.yaml@0f0a2e68572aa959f1e0a08dbf2a5c5e6ff5dd0c -
Trigger Event:
release
-
Statement type:
