Skip to main content

A package for extracting and formatting content from various sources

Project description

DataReader

A Python package for extracting and formatting content from various sources including PDFs, URLs, videos, and audio files.

Features

  • PDF processing with multiple backends (PyMuPDF, pypdf, markitdown)
  • Web page content extraction
  • Video content processing
  • Audio transcription
  • Markdown formatting

Installation

pip install keytake-datareader

All dependencies are included with the package by default, so you can immediately use all features without installing additional packages.

Quick Start

from datareader import DataReader

# Process a PDF file
text = DataReader.read_pdf("document.pdf")

# Process a URL
web_content = DataReader.read_url("https://example.com")

# Process a video file
transcript = DataReader.read_video("video.mp4")

# Process an audio file
audio_text = DataReader.read_audio("audio.mp3")

# Save as markdown
DataReader.save_markdown(text, "output.md")

Command Line Usage

The package provides command-line scripts for batch processing:

# Process PDFs
./run_pdf.sh

# Process URLs
./run_url.sh

Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

License

This project is licensed under the MIT License - see the LICENSE file for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

keytake_datareader-0.1.6.tar.gz (23.9 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

keytake_datareader-0.1.6-py3-none-any.whl (25.2 kB view details)

Uploaded Python 3

File details

Details for the file keytake_datareader-0.1.6.tar.gz.

File metadata

  • Download URL: keytake_datareader-0.1.6.tar.gz
  • Upload date:
  • Size: 23.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.11.5

File hashes

Hashes for keytake_datareader-0.1.6.tar.gz
Algorithm Hash digest
SHA256 e63bc27b82829d55055e1ce9968dcef339c32286eff6c52f860b7fc1977786c5
MD5 4ec01b9bb7e00c93fd8f13e0a01ee010
BLAKE2b-256 c75fe742077195a40b350a45a466b50d85fb4eb31eca44d44a80a22586d2be7b

See more details on using hashes here.

File details

Details for the file keytake_datareader-0.1.6-py3-none-any.whl.

File metadata

File hashes

Hashes for keytake_datareader-0.1.6-py3-none-any.whl
Algorithm Hash digest
SHA256 889d9eb37bf853496052d8d0c5d0744c8ecd2bd0435bfc8e0f4028c423cf143a
MD5 ef0f24ef2cdd58a2763678520272c6bf
BLAKE2b-256 4999ab804316f7663047ef9e106925d4eed4421f48c6e887c25377f3cccac96c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page