Skip to main content

Lumen

Illuminate your data

Build Status Linux/MacOS/Windows Build Status
Coverage codecov
Latest dev release Github tag dev-site
Latest release Github release PyPI version lumen version conda-forge version defaults version
Docs gh-pages site
Support Discourse
Lumen AI Diagram

Lumen is a fully open-source and extensible agent based framework for chatting with data and for retrieval augmented generation (RAG). The declarative nature of Lumen's data model make it possible for LLMs to easily generate entire data transformation pipelines, visualizations and other many other types of output. Once generated the data pipelines and visual output can be easily serialized, making it possible to share them, to continue the analysis in a notebook and/or build entire dashboards.

  • Generate SQL: Generate data pipelines on top of local or remote files, SQL databases or your data lake.
  • Provide context and embeddings: Give Lumen access to your documents to give the LLM the context it needs.
  • Visualize your data: Generate everything from charts to powerful data tables or entire dashboards using natural language.
  • Inspect, validate and edit results: All LLM outputs can easily be inspected for mistakes, refined, and manually edited if needed.
  • Summarize results and key insights: Have the LLM summarize key results and extract important insights.
  • Custom analyses, agents and tools: Extend Lumen custom agents, tools, and analyses to generate deep insights tailored to your domain.

Lumen sets itself apart from other agent based frameworks in that it focuses on being fully open and extensible. With powerful internal primitives for expressing complex data transformations the LLM can gain insights into your datasets out-of-the box and can be further tailored with custom agents, analyses and tools to empower even non-programmers to perform complex analyses without having to code. The customization makes it possible to generate any type of output, allow the user and the LLM to perform analyses tailored to your domain and look up additional information and context easily. Since Lumen is built on Panel it can render almost any type of output with little to no effort, ensuring that even the most esoteric usecase is easily possible.

The declarative Lumen data model further sets it apart from other tools, making it easy for LLMs to populate custom components and making it easy for the user to share the results. Entire multi-step data transformation pipelines be they in SQL or Python can easily be captured and used to drive custom visualizations, interactive tables and more. Once generated the declarative nature of the Lumen specification allows them to be shared, reproducing them in a notebook or composing them through a drag-and-drop interface into a dashboard.

Getting started

Lumen works with Python 3 and above on Linux, Windows, or Mac. The recommended way to install Lumen is using the conda command provided by Anaconda or Miniconda:

conda install -c pyviz lumen

or using PyPI:

pip install 'lumen[ai]'

Once installed you will be able to start a Lumen Explorer server by running (replace data.csv with your data):

lumen-ai serve data.csv

Check out the docs for more details!

Metadata

Release files for lumen 0.10.0

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for lumen 0.10.0
File Size Uploaded
lumen-0.10.0.tar.gz 479.6 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for lumen 0.10.0
File Interpreter ABI Platform
lumen-0.10.0-py3-none-any.whl Python 3 none any Details

Total release size: 1.0 MB

Release files / lumen-0.10.0.tar.gz

Download URL lumen-0.10.0.tar.gz
Size 479.6 kB
Tags Source
SHA-256 checksum
How to use checksums
a9b583ce83f6462b852c32a7ecfd7da0073698fe8b8d7cb97636b78c8ed3b7ee
BLAKE2b-256 checksum
How to use checksums
6d6e999387990678de5cd9481a4bfc2443802061ab190ce8770cfad513b3f1f7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.9

Release files / lumen-0.10.0-py3-none-any.whl

Download URL lumen-0.10.0-py3-none-any.whl
Size 548.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
031d1ffd00361986bc732e52bac003f272d88544e0accdf396a428e53d280eef
BLAKE2b-256 checksum
How to use checksums
67bdc1049675ff0bc010f9039d2f2534f209cbd532d04db52c5e9eac4322002e
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.9

Release history Release notifications | RSS feed

1.3.0

2 release files

1.2.1

2 release files

1.2.0

2 release files

1.1.0

2 release files

1.0.0

2 release files

This release

0.10.0 This release

2 release files

0.9.0

2 release files

0.8.0

2 release files

0.7.0

2 release files

0.6.3

2 release files

0.6.2

2 release files

0.6.1

2 release files

0.6.0

2 release files

0.5.1

2 release files

0.5.0

2 release files

0.4.1

2 release files

0.4.0

2 release files

0.3.2

2 release files

0.3.1

2 release files

0.3.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page