langchain-yt-dlp

langchain-yt-dlp is a Python package that extends LangChain by providing an improved YouTube integration using yt-dlp. This package addresses a critical limitation in the existing LangChain YoutubeLoader. The original implementation, which relied on pytube, became unable to fetch YouTube metadata due to changes in YouTube's structure. langchain-yt-dlp resolves this by leveraging the robust yt-dlp library, providing a more reliable YouTube document loader.

Key Features

• Retrieve metadata (e.g., title, description, author, view count, publish date) using the yt-dlp library.
• Maintain compatibility with LangChain's existing loader interface.

Installation

To install the package, use:

pip install langchain-yt-dlp

Ensure you have the following dependencies installed:

• langchain
• yt-dlp

Install them with:

pip install langchain yt-dlp

Usage

Here’s how you can use the YoutubeLoader from langchain-yt-dlp:

Basic Example

Loading From a YouTube URL

from langchain_yt_dlp.youtube_loader import YoutubeLoaderDL

# Initialize using a YouTube URL
loader = YoutubeLoaderDL.from_youtube_url(
    youtube_url="https://www.youtube.com/watch?v=dQw4w9WgXcQ", 
    add_video_info=True
)

documents = loader.load()
print(documents)

Parameters

YoutubeLoaderDL Constructor

Testing

To run the tests:

1. Clone the repository:

   git clone https://github.com/aqib0770/langchain-yt-dlp
   cd langchain-yt-dlp
   

2. Install development dependencies:

   pip install -r requirements.txt
   

3. Run the tests:

   pytest tests/test_youtube_loader.py
   

Contributing

Contributions are welcome! If you have ideas for new features or spot a bug, feel free to:

• Open an issue on GitHub.
• Submit a pull request.

License

This project is licensed under the MIT License. See the LICENSE file for details.

Acknowledgements

• LangChain for providing the base integration framework.
• yt-dlp for enabling enhanced YouTube metadata extraction.