Skip to main content

Assembler components for the Sayou Data Platform

Project description

sayou-assembler

PyPI version License Docs

The Knowledge Builder for Sayou Fabric.

sayou-assembler is the construction site of the data pipeline. It takes the standardized SayouNode objects produced by the Wrapper and assembles them into target-specific formats ready for loading into databases.

It bridges the gap between the abstract data model and concrete storage technologies (Graph DBs, Vector DBs).

💡 Core Philosophy

"Build Once, Deploy Anywhere."

The Assembler decouples the structure of knowledge from the syntax of the database.

  • Graph Builder: Constructs a topology of Nodes and Edges (including automatic reverse linking).
  • Vector Builder: Transforms nodes into embeddings and metadata payloads.
  • Query Builder: Generates specific query languages like Cypher or SQL.

📦 Installation

pip install sayou-assembler

⚡ Quick Start

The AssemblerPipeline converts standardized data into database payloads.

from sayou.assembler.pipeline import AssemblerPipeline

def run_demo():
    # 1. Initialize (Inject embedding function for Vector Builder)
    pipeline = AssemblerPipeline()
    pipeline.initialize(embedding_fn=my_embedding_func)

    # 2. Input Data (from sayou-wrapper)
    wrapper_output = {
        "nodes": [
            {"node_id": "doc_1", "node_class": "sayou:Document", "attributes": {"text": "..."}},
            # ...
        ]
    }

    # 3. Build for Graph DB (Nodes + Edges)
    graph_data = pipeline.run(wrapper_output, strategy="graph")
    print(f"Edges created: {len(graph_data['edges'])}")
    
    # 4. Build for Vector DB (Embeddings)
    vector_data = pipeline.run(wrapper_output, strategy="vector")
    print(f"Vectors created: {len(vector_data)}")

if __name__ == "__main__":
    def my_embedding_func(text): return [0.1, 0.2, 0.3] # Dummy
    run_demo()

🔑 Key Components

Builders

  • GraphBuilder: Converts nodes into a generic graph structure (Dictionary). Automatically creates reverse edges (e.g., hasChild from hasParent) to ensure bi-directional traversability.
  • VectorBuilder: Extracts text from nodes, computes embeddings, and formats payloads for Vector DBs.

Plugins

  • CypherBuilder: Generates Neo4j MERGE queries to insert nodes and relationships idempotently.

🤝 Contributing

We welcome builders for other targets (e.g., SqlBuilder, GremlinBuilder).

📜 License

Apache 2.0 License © 2025 Sayouzone

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

sayou_assembler-0.1.3.tar.gz (15.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

sayou_assembler-0.1.3-py3-none-any.whl (12.6 kB view details)

Uploaded Python 3

File details

Details for the file sayou_assembler-0.1.3.tar.gz.

File metadata

  • Download URL: sayou_assembler-0.1.3.tar.gz
  • Upload date:
  • Size: 15.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.13.7

File hashes

Hashes for sayou_assembler-0.1.3.tar.gz
Algorithm Hash digest
SHA256 81e324e243628b21c013e833c53fb681247242a7671d5d5e84770035e04c6fe7
MD5 787c630d8f6695e6e862f531783340cb
BLAKE2b-256 01b6770d27bfdfeddc4f038e52c2850b888ab88bd2c0c5d91aa9f23e4b18a57e

See more details on using hashes here.

File details

Details for the file sayou_assembler-0.1.3-py3-none-any.whl.

File metadata

File hashes

Hashes for sayou_assembler-0.1.3-py3-none-any.whl
Algorithm Hash digest
SHA256 3e53383a17da2c644f81c054a1c4cb12294649e9050a0607d0a2db0f6b4e281a
MD5 1b451e5057d348cd2c2e7c82154f3416
BLAKE2b-256 c7a121485b58dcb33a67944b89dde734ee2c9798e86233386b66c31a550bb33e

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page