allyin 0.1.0

Allyin: Modular AI tools for enterprise data processing

📚 multimodal2text — Universal Unstructured Content Extractor

multimodal2text is a plug-and-play Python library that extracts clean, structured text from unstructured files like PDFs, images, audio, slides, and HTML. Ideal as a preprocessing layer for RAG pipelines, LLM agents, and enterprise data ingestion systems.

---

🔧 Installation

pip install -r requirements.txt

Ensure dependencies like Tesseract (brew install tesseract) and ffmpeg (brew install ffmpeg) are installed if running OCR or audio transcription.

---

🏗️ Directory Structure

multimodal2text/
  ├── dispatcher.py         # Central router
  ├── pdf_parser.py
  ├── image_ocr.py
  ├── audio_transcriber.py
  ├── slide_parser.py
  ├── html_cleaner.py
  ├── data_cleaner.py       # Final text cleaner
  ├── utils.py
tests/
  └── test_*.py             # Test cases for all parsers

---

⚙️ How It Works

from allyin.multimodal2text import extract_text

text = extract_text("path/to/your/file.pdf")  # Works for .pdf, .png, .wav, .pptx, .html
print(text)

The dispatcher:

1. Detects file type by extension
2. Calls the correct parser (PDF, OCR, Whisper, etc.)
3. Passes the raw text through data_cleaner.py to normalize

---

📥 Supported Formats

Format	Module	Notes
.pdf	pdf_parser.py	Uses PyMuPDF (fitz)
.png/jpg	image_ocr.py	Uses Tesseract OCR
.wav/mp3/mp4	audio_transcriber.py	Uses OpenAI Whisper
.pptx	slide_parser.py	Uses python-pptx
.html	html_cleaner.py	Strips boilerplate + tags

---

🧪 Testing

pytest -s tests/

Sample files are provided under tests/sample_files/.

---

💡 Use Cases

• Input preprocessor for RAG pipelines
• Cleaner for enterprise document search
• Bridge between files and embeddings
• ETL for AI agent ingestion

---

📁 Example Script: run_demo.py

from allyin.multimodal2text import extract_text

file_path = "tests/sample_files/sample.pdf"
print(extract_text(file_path))

---

🚧 Notes

• You can add .docx, .xlsx, or .json support by extending dispatcher.py and adding a new parser module.
• Tesseract and Whisper must be installed and callable in your system PATH.
• These are external system binaries, not Python packages.

  brew install ffmpeg

  brew install tesseract