YouTube Scrapper

The YouTube scrapper is a data pipeline that allows you to extract data from videos posted on YouTube. The scrapper will extract information such as; video titles, descriptions, the number of views the video has and all the users or viewers' comments per each video. Information extracted is dumped into a csv file which can then be uploaded to an Amazon RDS database.

Getting Started

1. Make sure pip and Chromedriver is installed.
2. Download package by using pip install Youtube-scrapper in console
3. Run 'python -m youtube_scrapper' on your terminal
4. A prompt to enter the following information will pop up;
   1. channel - this takes the youtube channel you want to scrape data from
   2. scroll_range - this indicates how many video you want the scrapper to look and grab information from.
5. Once the information is passed in, the scrapper will start grabbing all information requested.
6. Once finished, the data is returned in a csv file which can be found at the directory level the package was run.

Note

• When the scroll_range value is 0, 30 videos (The least amount of videos that will be scrapped) are returned from the channel specified. Each time the value goes up by 1, 30 more videos are returned.
• Run time takes a while (approximately 30mins for 30 videos)

Dependencies

• Python 3.7.9
• selenium 3.141.0
• pandas 1.3.2