Scrape user data from Goodreads
Project description
Goodreads User Scraper
Scrape Goodreads User Data: Profile, Book Shelves, Books, Authors
Contents
Usage
Using pip:
pip install goodreads-user-scraper
goodreads-user-scraper --user_id <your id> --output_dir goodreads-data
Using pipx:
pipx run goodreads-user-scraper --user_id <your id> --output_dir goodreads-data
Arguments
--user_id
- Description: The user whose data should be scraped. Find your user id using these directions.
- Required: Yes
--output_dir
- Description: The directory where all scraped data will be output.
- Required: No
- Default:
goodreads-data
--skip_user_info
- Description: Whether the script should skip scraping user information.
- Required: No
- Default:
False
--skip_shelves
- Description: Whether the script should skip scraping shelves.
- Required: No
- Default:
False
--skip_authors
- Description: Whether the script should skip scraping authors.
- Required: No
- Default:
False
Troubleshooting
Ensure that your profile is viewable by anyone:
- Navigate to the Goodreads Account Settings page
- Click on the
Settings
tab - In the
Privacy
section, under the Who Can View My Profile question, select "anyone"
Development
-
Clone the GitHub repository
git clone https://github.com/YashTotale/goodreads-user-scraper.git
-
Run the install script
sh scripts/install.sh
-
Make changes
-
Run the test script
sh scripts/test.sh
Publishing
-
Create
.env
TWINE_USERNAME=<foo> TWINE_PASSWORD=<bar>
-
Run the publish script
sh scripts/publish.sh <patch|minor|major>
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for goodreads-user-scraper-1.2.4.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0b68b44349723222291641b87df771adee21ea27dd8fb1ce1f877c4eb2642e62 |
|
MD5 | 224922836f46436f6928c12fca6ac8d1 |
|
BLAKE2b-256 | 67c0b81084f671e2ebba4e02a54e7b41e23604f2e9034addc5cd4814f4f608c3 |
Close
Hashes for goodreads_user_scraper-1.2.4-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 18b7d86f21bfa0a6afb6d037485c72ad60450fc3545632900314fa84b3343d9a |
|
MD5 | 77aee595cf830ced9610f01bebefbf1a |
|
BLAKE2b-256 | a731b4c8641818d7e8e78c5418a0184bd22e247498082219f4d035299fbb6598 |