Skip to main content

A package for extracting and formatting content from various sources

Project description

DataReader

A Python package for extracting and formatting content from various sources including PDFs, URLs, videos, and audio files.

Features

  • PDF processing with multiple backends (PyMuPDF, pypdf, markitdown)
  • Web page content extraction
  • Video content processing
  • Audio transcription
  • Markdown formatting

Installation

Basic Installation

pip install keytake-datareader

With Optional Dependencies

# For PDF processing
pip install "keytake-datareader[pdf]"

# For audio processing
pip install "keytake-datareader[audio]"

# For video processing
pip install "keytake-datareader[video]"

# For all features
pip install "keytake-datareader[all]"

Quick Start

from datareader import DataReader

# Process a PDF file
text = DataReader.read_pdf("document.pdf")

# Process a URL
web_content = DataReader.read_url("https://example.com")

# Process a video file
transcript = DataReader.read_video("video.mp4")

# Process an audio file
audio_text = DataReader.read_audio("audio.mp3")

# Save as markdown
DataReader.save_markdown(text, "output.md")

Command Line Usage

The package provides command-line scripts for batch processing:

# Process PDFs
./run_pdf.sh

# Process URLs
./run_url.sh

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

keytake_datareader-0.1.4.tar.gz (21.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

keytake_datareader-0.1.4-py3-none-any.whl (24.0 kB view details)

Uploaded Python 3

File details

Details for the file keytake_datareader-0.1.4.tar.gz.

File metadata

  • Download URL: keytake_datareader-0.1.4.tar.gz
  • Upload date:
  • Size: 21.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.5

File hashes

Hashes for keytake_datareader-0.1.4.tar.gz
Algorithm Hash digest
SHA256 641a219f2ed0cb88d6d275f2e76448b8295351b9fac77c69f56ffe54ce444ecd
MD5 d5ecf802de74b5e296fd03d858f50266
BLAKE2b-256 1268e434cc490c956985c3167fa9129b53f0a99f87a049f268a71c00a358b2d2

See more details on using hashes here.

File details

Details for the file keytake_datareader-0.1.4-py3-none-any.whl.

File metadata

File hashes

Hashes for keytake_datareader-0.1.4-py3-none-any.whl
Algorithm Hash digest
SHA256 d49df1be58f093857a0ed86cb439ca89f145cbe60c8d06e1bf42a2a3b27c01f6
MD5 a64b80efc80170a8d78a65de4dddd3d0
BLAKE2b-256 47a70e5c87859c103fa45a4f2e99f313f08af0853194df3babd57d604cd0a55d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page