Scrape user data from Goodreads
Project description
Goodreads User Scraper
Scrape Goodreads User Data: Profile, Book Shelves, Books, Authors
Contents
Usage
Using pip:
pip install goodreads-user-scraper
goodreads-user-scraper --user_id <your id> --output_dir goodreads-data
Using pipx:
pipx run goodreads-user-scraper --user_id <your id> --output_dir goodreads-data
Arguments
--user_id
- Description: The user whose data should be scraped. Find your user id using these directions.
- Required: Yes
--output_dir
- Description: The directory where all scraped data will be output.
- Required: No
- Default:
goodreads-data
--skip_user_info
- Description: Whether the script should skip scraping user information.
- Required: No
- Default:
False
--skip_shelves
- Description: Whether the script should skip scraping shelves.
- Required: No
- Default:
False
--skip_authors
- Description: Whether the script should skip scraping authors.
- Required: No
- Default:
False
Troubleshooting
Ensure that your profile is viewable by anyone:
- Navigate to the Goodreads Account Settings page
- Click on the
Settings
tab - In the
Privacy
section, under the Who Can View My Profile question, select "anyone"
Development
-
Clone the GitHub repository
git clone https://github.com/YashTotale/goodreads-user-scraper.git
-
Run the install script
sh scripts/install.sh
-
Make changes
-
Run the test script
sh scripts/test.sh
Publishing
-
Create
.env
TWINE_USERNAME=<foo> TWINE_PASSWORD=<bar>
-
Run the publish script
sh scripts/publish.sh <patch|minor|major>
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for goodreads-user-scraper-1.2.2.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | a38ee278047c8acc02d4ae0f01045dfc437adc53a299c55e02142ef47a743723 |
|
MD5 | 55bbfeb3ade66b7612604aa62574c219 |
|
BLAKE2b-256 | 21af74c076a981f820857552934d955df36dc653095f023c811c896a8cdb0e90 |
Close
Hashes for goodreads_user_scraper-1.2.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3df54a3b68c6b17d49735f57433c899aebc150a2ed6133016bfb074afdc247f1 |
|
MD5 | e1592ffe804f8d4a304775c3664f97d0 |
|
BLAKE2b-256 | f3f94bdc4474fe8190a77f2ee54e805b4eb80e585839e2f1b0e9c90be8b1d75c |