Skip to main content

Sync external data sources (GitHub, Google Drive, Notion, filesystem, web crawler) into the Mnemosyne memory substrate. CLI + Python API, incremental sync, content deduplication, per-source chunking strategies.

Project description

mnemosyne-connectors

PyPI version License: MIT

Sync external data sources (GitHub, Google Drive, Notion, filesystem, web crawler) into the Mnemosyne memory substrate. CLI + Python API, with incremental sync, content deduplication, and per-source chunking strategies.

Install

pip install mnemosyne-connectors
# or with specific connectors:
pip install mnemosyne-connectors[github]
pip install mnemosyne-connectors[gdrive]
pip install mnemosyne-connectors[notion]
pip install mnemosyne-connectors[all]

Quick start

The 0.1.0 release ships the BaseConnector interface and ConnectorManager. The connector-specific implementations (GitHub, Google Drive, Notion, filesystem, web crawler) are imported lazily to avoid forcing all dependencies on every install.

from mnemosyne_connectors import (
    BaseConnector,
    ConnectorConfig,
    ConnectorManager,
    GitHubConnector,  # requires [github] extra
    NotionConnector,  # requires [notion] extra
)

manager = ConnectorManager(api_key="mn_...")

# Register a GitHub connector
gh = GitHubConnector(ConnectorConfig(
    name="my-repo",
    config={"token": "ghp_...", "repos": ["owner/repo"]},
    container_tag="engineering",
))
manager.register(gh)

# Sync everything
results = manager.sync_all()
print(results)  # {connector_id: items_synced}

License

MIT © Geass Labs

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mnemosyne_connectors-0.1.0.tar.gz (5.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mnemosyne_connectors-0.1.0-py3-none-any.whl (6.4 kB view details)

Uploaded Python 3

File details

Details for the file mnemosyne_connectors-0.1.0.tar.gz.

File metadata

  • Download URL: mnemosyne_connectors-0.1.0.tar.gz
  • Upload date:
  • Size: 5.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.2.0 CPython/3.14.2

File hashes

Hashes for mnemosyne_connectors-0.1.0.tar.gz
Algorithm Hash digest
SHA256 0a89abf8918333437ba405d45b39aed226274452d6bf26fbc893833164c82974
MD5 88a81cd8ff0ba912d53496f6ae1efa22
BLAKE2b-256 06d7e446c19c9a7eb8434772f40ef22227b3fd49625cdf621dc8c7201b7ca6a0

See more details on using hashes here.

File details

Details for the file mnemosyne_connectors-0.1.0-py3-none-any.whl.

File metadata

File hashes

Hashes for mnemosyne_connectors-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 7537b640007f58c9b2da69c46d48b8c189822dc7dc8ef719e7347bc05f5111f9
MD5 7adaa4ae9ec823d95445840edf751c0e
BLAKE2b-256 184f622cc76fed02f89237f72b0c9c5ea301b2502d3840bbed7f07728fe80e50

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page