Skip to main content

Lumen

Illuminate your data

Build Status Linux/MacOS/Windows Build Status
Coverage codecov
Latest dev release Github tag dev-site
Latest release Github release PyPI version lumen version conda-forge version defaults version
Docs gh-pages site
Support Discourse
Lumen AI Diagram

Lumen is a fully open-source and extensible agent based framework for chatting with data and for retrieval augmented generation (RAG). The declarative nature of Lumen's data model make it possible for LLMs to easily generate entire data transformation pipelines, visualizations and other many other types of output. Once generated the data pipelines and visual output can be easily serialized, making it possible to share them, to continue the analysis in a notebook and/or build entire dashboards.

  • Generate SQL: Generate data pipelines on top of local or remote files, SQL databases or your data lake.
  • Provide context and embeddings: Give Lumen access to your documents to give the LLM the context it needs.
  • Visualize your data: Generate everything from charts to powerful data tables or entire dashboards using natural language.
  • Inspect, validate and edit results: All LLM outputs can easily be inspected for mistakes, refined, and manually edited if needed.
  • Summarize results and key insights: Have the LLM summarize key results and extract important insights.
  • Custom analyses, agents and tools: Extend Lumen custom agents, tools, and analyses to generate deep insights tailored to your domain.

Lumen sets itself apart from other agent based frameworks in that it focuses on being fully open and extensible. With powerful internal primitives for expressing complex data transformations the LLM can gain insights into your datasets out-of-the box and can be further tailored with custom agents, analyses and tools to empower even non-programmers to perform complex analyses without having to code. The customization makes it possible to generate any type of output, allow the user and the LLM to perform analyses tailored to your domain and look up additional information and context easily. Since Lumen is built on Panel it can render almost any type of output with little to no effort, ensuring that even the most esoteric usecase is easily possible.

The declarative Lumen data model further sets it apart from other tools, making it easy for LLMs to populate custom components and making it easy for the user to share the results. Entire multi-step data transformation pipelines be they in SQL or Python can easily be captured and used to drive custom visualizations, interactive tables and more. Once generated the declarative nature of the Lumen specification allows them to be shared, reproducing them in a notebook or composing them through a drag-and-drop interface into a dashboard.

Getting started

Lumen works with Python 3 and above on Linux, Windows, or Mac. The recommended way to install Lumen is using the conda command provided by Anaconda or Miniconda:

conda install -c pyviz lumen

or using PyPI:

pip install 'lumen[ai]'

Once installed you will be able to start a Lumen Explorer server by running (replace data.csv with your data):

lumen-ai serve data.csv

Check out the docs for more details!

Metadata

Release files for lumen 0.10.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for lumen 0.10.1
File Size Uploaded
lumen-0.10.1.tar.gz 489.5 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for lumen 0.10.1
File Interpreter ABI Platform
lumen-0.10.1-py3-none-any.whl Python 3 none any Details

Total release size: 1.0 MB

Release files / lumen-0.10.1.tar.gz

Download URL lumen-0.10.1.tar.gz
Size 489.5 kB
Tags Source
SHA-256 checksum
How to use checksums
4ab077bf87357649c3b75a1776ab9655b246b766efddf96e5dbefaab3781b568
BLAKE2b-256 checksum
How to use checksums
a49c0320adc7380267cc21ba7edf4dcdfe8ac555337b62b202e3a9f30637b05d
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.9

Release files / lumen-0.10.1-py3-none-any.whl

Download URL lumen-0.10.1-py3-none-any.whl
Size 559.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
edd68b9843ec466049d53a62c1a8fcfd056f6d7df696dbb8d7359c189589251a
BLAKE2b-256 checksum
How to use checksums
17ade18f050df085918e75b0e7d9bc9a026b92cc03c9c190f74b6a11a52966ad
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/6.1.0 CPython/3.12.9

Release history Release notifications | RSS feed

1.3.0

2 release files

1.2.1

2 release files

1.2.0

2 release files

1.1.0

2 release files

1.0.0

2 release files

This release

0.10.1 This release

2 release files

0.10.0

2 release files

0.9.0

2 release files

0.8.0

2 release files

0.7.0

2 release files

0.6.3

2 release files

0.6.2

2 release files

0.6.1

2 release files

0.6.0

2 release files

0.5.1

2 release files

0.5.0

2 release files

0.4.1

2 release files

0.4.0

2 release files

0.3.2

2 release files

0.3.1

2 release files

0.3.0

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page