Scrape chat content from TakeLessons.com
Project description
Scrape the chat logs from TakeLessons
What is this?
If you noticed that TakeLessons doesn't have an API or a way to export your own data you can use this package to get at it.
How do I use it?
Prerequisites
- Install Chrome
- Find the correct selenium driver version for your install here
- Add it to PATH or make a note of where it is
pip install takelessons-scraper
Example Usage:
# Assume some db object you can save your data to
db = SomeDBStore()
from takelessons_scraper import TakeLessonsScraper
chromedriver_path = '/path/to/chromedriver'
username = 'username'
password = 'password'
scraper = TakeLessonsScraper(chromedriver_path)
# login to load cookies behind scenes
scraper.login(username, password)
# get a block of chat data up to date
chat_date = '2020-01-01'
chat_log = scraper.get_chat_history(chat_date) # Chat obj, can get raw json back
db.save(chat_log)
Notes:
Please consider this a hobby project to be used as reference. Since it is a scraper I expect it to fail as regularly as the source is updated... which could be at any time and not within my control.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for takelessons-scraper-0.0.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 15b7c3c74c7f779b45cadd957fd066be71f004433bef5c4fc349e7708b2222ec |
|
MD5 | 18913ab8c41895eb092772fb993701da |
|
BLAKE2b-256 | 14861f22335acfe63938e36d2b8b29d33be7bcdbd9b920c2f199b81a546f61de |
Close
Hashes for takelessons_scraper-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6f6b3c4f60f314746dd81c4d616ec725457055c4274c7b3a9406dfcfa1a94956 |
|
MD5 | 804c76b86e5b12fc3aac97537c25f8a6 |
|
BLAKE2b-256 | df1d7f29821e18e0106bd848d69cbdd7d8630cf8702047c3d7f384a0ee65808d |