datannurpy 0.20.0a1

Python library for datannur catalog metadata management

datannurpy

datannurpy is the Python builder for datannur catalogs: it scans files and databases, extracts metadata and statistics, and exports a ready-to-use catalog.

Key features:

• Broad format support - CSV, Excel, Parquet, Delta Lake, Iceberg, SAS, SPSS, Stata
• Database introspection - PostgreSQL, MySQL, Oracle, SQL Server, SQLite, DuckDB
• Remote & cloud storage - SFTP, S3, Azure Blob, GCS via fsspec
• Rich metadata - schema, statistics, frequencies, modalities, auto-tagging
• Incremental scans - only rescan what changed between runs
• YAML or Python API - declarative configuration or programmatic control

Quick start

pip install datannurpy

# catalog.yml
app_path: ./my-catalog
open_browser: true

add:
  - folder: ./data
    include: ["*.csv", "*.xlsx", "*.parquet"]

  - database: sqlite:///mydb.sqlite

python -m datannurpy catalog.yml

Documentation

📖 Full documentation: docs.datannur.com/builder

🌐 Website: datannur.com

🚀 Demo: dev.datannur.com

Contributing

For development documentation and contributing guidelines, see CONTRIBUTING.md.

License

MIT - see LICENSE. All dependencies are MIT/Apache 2.0/BSD compatible.