Scrape user data from Goodreads
Project description
Goodreads User Scraper
Contents
Usage
Using pip:
pip install goodreads-user-scraper
goodreads-user-scraper --user_id 54739262 --output_dir books
Using pipx:
pipx run goodreads-user-scraper --user_id 54739262 --output_dir books
Arguments
--user-id
- Description: The user whose data should be scraped. Find your user id using these directions.
- Required: Yes
--output-dir
- Description: The directory where all scraped data will be output.
- Required: No
- Default:
goodreads-data
--skip_user_info
- Description: Whether the script should skip scraping user information.
- Required: No
- Default:
False
--skip_shelves
- Description: Whether the script should skip scraping shelves.
- Required: No
- Default:
False
Troubleshooting
Ensure that your profile is viewable by anyone:
- Navigate to the Goodreads Account Settings page
- Click on the
Settings
tab - In the
Privacy
section, under the Who Can View My Profile question, select "anyone"
Development
-
Clone the GitHub repository
git clone https://github.com/YashTotale/goodreads-user-scraper.git
-
Run the install script
sh scripts/install.sh
-
Make changes
-
Run the test script
sh scripts/test.sh
Publishing
-
Create
.env
TWINE_USERNAME=<foo> TWINE_PASSWORD=<bar>
-
Run the publish script
sh scripts/publish.sh <patch|minor|major>
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for goodreads-user-scraper-1.0.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 757a519303e41b54d3be426df644c4c79fadd1dc4bfe4b6ce6041e072a295baf |
|
MD5 | 60eed480e8f4c663fd386cd5aea0eace |
|
BLAKE2b-256 | 69fb455c21015ef9d7d3fb2667c12980b8a5a09fc9f20b67384a5e8df33d02a1 |
Close
Hashes for goodreads_user_scraper-1.0.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 37ef8e88ab126f7ce560a15a73fbb4b8381e59a25c26efcae372fecadd2637ed |
|
MD5 | 1ade4ad51f74b085affa3d17b63616a0 |
|
BLAKE2b-256 | 1c2d50085fbd33013cbffdfdd3a13ed7e9951f15ffc4c1151bd21d5ac59bfb36 |