Skip to main content

Livechat scraper for Youtube video streams

Project description

youtube-livechat-scraper

A tool to scrape youtube livechat data I came up with while watching vtubers. It rips almost all data from a VOD's livechat including the following:

  • Chat messages
  • Superchats
  • Memberships joined
  • Memberships gifted and received
  • Purchased Stickers

All of the data can be wrapped up in a large raw JSON object that also contains lots of metadata from the responses, like the author, the time the message got sent, etc.

USAGE:

Requires the following python3 packages:

  • NOTE: These packages will be installed via pip when installing the scraper.
  • BeautifulSoup
  • Requests

How to use:

  • Import the LiveChatScraper from scrapers.liveChatScraper to wherever you want to make the scraping call.
  • Find a VOD URL and copy it
  • Create a LiveChatScraper object and pass in the VOD's URL.
  • Call the scrape() method on the created scraper object and the scrape will run.
  • Once the scrape is completed, you can call ouputMessages() to get a dictionary with all the scraped data.
  • You can all save the scraped data as a JSON to a fill by calling the writeToFile method passing the OUTPUT_JSON constant
  • example.py has a working example which saves the data to different formats

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

youtube_livechat_scraper_ohn0-1.0.5.tar.gz (15.1 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

youtube_livechat_scraper_ohn0-1.0.5-py3-none-any.whl (26.5 kB view details)

Uploaded Python 3

File details

Details for the file youtube_livechat_scraper_ohn0-1.0.5.tar.gz.

File metadata

File hashes

Hashes for youtube_livechat_scraper_ohn0-1.0.5.tar.gz
Algorithm Hash digest
SHA256 a21f85f391bbd815caddcf9add8a3c1bf5f88ad9369a2a0ae6e3be6d385734ae
MD5 0d9299fedb429a0483ad24db2f8de0f2
BLAKE2b-256 519def3a79e43b3d26819fd0ede147723039189bd8760f84a46bb7d7f025b6d4

See more details on using hashes here.

File details

Details for the file youtube_livechat_scraper_ohn0-1.0.5-py3-none-any.whl.

File metadata

File hashes

Hashes for youtube_livechat_scraper_ohn0-1.0.5-py3-none-any.whl
Algorithm Hash digest
SHA256 df3f28bd20083749f5b0af8a19517e676f5b489b1b5ad644663dfd1cfa26b336
MD5 c7ac0d5187df4d02ed4c52c998a5a695
BLAKE2b-256 3db912e91818f18cbe9477f65bc233a7d45701e5e26fad2fca12e1cc9b4dba8c

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page