tubelearns 1.1.7

Python script for extracting,cleaning and tokenization YouTube video transcripts for Pre-Processing in machine learning.

Tube-Data: YouTube Video Transcript Extractor

Tube-Data is a Python script designed for extracting and cleaning YouTube video transcripts for preprocessing in machine learning. This versatile tool streamlines the process of acquiring high-quality text data from YouTube videos, making it ideal for various natural language processing tasks, sentiment analysis, speech recognition, and more.

Features

• Extracts video transcripts from YouTube videos.
• Saves cleaned transcripts into separate text files.
• Supports individual video URLs, batch processing from a list of URLs, and entire playlists.
• Streamlines the dataset collection process for machine learning applications.
• New Feature: Tokenization and Punctuation Removal for text preprocessing and cleaning.

Installation

You can install TubeLearns using pip:

pip install tubelearns

Usage

Playlist Grabbing

from tubelearns import Acquisition

# Initialize the Acquisition class
model = Acquisition()

# Grab transcripts from a YouTube playlist
playlist_url = 'https://www.youtube.com/your_playlist_url'
model.playlist_grab(playlist_url, name="raw_data")

Extract Video Links from Playlist

# Extract video links from a YouTube playlist
playlist_url = 'https://www.youtube.com/your_playlist_url'
model.play2text(playlist_url)

Tokenization and Cleaning

from tubelearns.tokenizers import Tokenization, Cleaning

# Initialize the Tokenization class
tokenizer = Tokenization()
cleaner = Cleaning()

# Tokenize text data
text_data = "Your input text here."
tokenized_data = tokenizer.tokenize_raw(text_data)
cleaned_data = cleaner.punct_raw(tokenized_data)

Refer to the TubeLearns documentation for detailed usage instructions and examples.

Contributing

If you'd like to contribute to TubeLearns or report issues, please check out the GitHub repository.

License

This project is licensed under the MIT License - see the LICENSE.md file for details.

Acknowledgments

• YouTube Transcript API
• PyTube
• spaCy
• num2words

---

Enjoy using TubeLearns! If you have any questions or encounter issues, please don't hesitate to get in touch.