Pebblo Gen-AI Data Analyzer
Project description
Pebblo
Pebblo enables developers to safely load data and promote their Gen AI app to deployment without worrying about the organization’s compliance and security requirements. The project identifies semantic topics and entities found in the loaded data and summarizes them on the UI or a PDF report.
Pebblo has two components.
- Pebblo Daemon - a REST api application with topic-classifier, entity-classifier and reporting features
- Pebblo Safe DataLoader - a thin wrapper to Gen-AI framework's data loaders
Pebblo Daemon
Installation
Pre-requisites
Mac OSX
brew install pango
Linux (debian/ubuntu)
sudo apt-get install libpango-1.0-0 libpangoft2-1.0-0
Install Pebblo Daemon
pip install pebblo
Run Pebblo daemon
pebblo
Pebblo daemon now listens to localhost:8000
to accept Gen-AI application data snippets for inspection and reporting.
Pebblo Safe DataLoader for Langchain
Pebblo Safe DataLoader
currently supports Langchain framework. See this document for code samples and more details.
Contribution
Pebblo is a open-source community project. If you want to contribute see Contributor Guidelines for more details.
License
Pebblo is released under the MIT License
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.