ETLs fro LLMs
Project description
What is bisheng-unstructured?
Bisheng-unstructured is an open-source unstructured data parsing library built to power LLM applications like pretrain, finetune, prompting engineering. Bisheng-unstructured makes the unstructured data porcessing more easily and provides a consistent user experience regardless of any file types.
The project is a sub-project of bisheng.
Key features
- High precision pdf layout parser
- High precision table structure recovering
- High precision OCR ability
- More friendly for token prossing for the visual text element, like table, list
Quick start
Start With Bisheng Platform
Use as a chain node ElemUnstructureLoader
Start with DataElem Services.
We provide a open cloud service for easily use. See free trial.
Install bisheng-unstructured
- Install from pip:
pip install bisheng-unstructured
- Quick Start Guide
Using from pre-builded image
Documentation
For guidance on installation, development, deployment, and administration, check out bisheng-unstructured Docs.
Issues
Reporting problems, asking questions We appreciate any feedback, questions or bug reporting regarding this project.
User can posting Issues, follow the process outlined in the Stack Overflow document.
For questions, we recommend posting in our community GitHub Discussions.
Acknowledgments
bisheng-unstructured adopts dependencies from the following:
- Thanks to unstructured for the main framework.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distributions
Built Distribution
File details
Details for the file bisheng_unstructured-0.0.3.post4-py3-none-any.whl
.
File metadata
- Download URL: bisheng_unstructured-0.0.3.post4-py3-none-any.whl
- Upload date:
- Size: 1.4 MB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/5.0.0 CPython/3.8.18
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | d22a41a12a01b833730afc4f1af625dc4e5afd35d6891e477f7f51147b08a3fd |
|
MD5 | d9ab98617d098aa84e4321209b29e937 |
|
BLAKE2b-256 | 95d60a300fd82853066416d53635846101740ade967c5fcbba5ee347c37d2450 |