Scrape user data from Goodreads
Project description
Goodreads User Scraper
Contents
Usage
Using pip:
pip install goodreads-user-scraper
goodreads-user-scraper --user_id <your id> --output_dir goodreads-data
Using pipx:
pipx run goodreads-user-scraper --user_id <your id> --output_dir goodreads-data
Arguments
--user_id
- Description: The user whose data should be scraped. Find your user id using these directions.
- Required: Yes
--output_dir
- Description: The directory where all scraped data will be output.
- Required: No
- Default:
goodreads-data
--skip_user_info
- Description: Whether the script should skip scraping user information.
- Required: No
- Default:
False
--skip_shelves
- Description: Whether the script should skip scraping shelves.
- Required: No
- Default:
False
--skip_authors
- Description: Whether the script should skip scraping authors.
- Required: No
- Default:
False
Troubleshooting
Ensure that your profile is viewable by anyone:
- Navigate to the Goodreads Account Settings page
- Click on the
Settings
tab - In the
Privacy
section, under the Who Can View My Profile question, select "anyone"
Development
-
Clone the GitHub repository
git clone https://github.com/YashTotale/goodreads-user-scraper.git
-
Run the install script
sh scripts/install.sh
-
Make changes
-
Run the test script
sh scripts/test.sh
Publishing
-
Create
.env
TWINE_USERNAME=<foo> TWINE_PASSWORD=<bar>
-
Run the publish script
sh scripts/publish.sh <patch|minor|major>
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for goodreads-user-scraper-1.2.0.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 26b1e5654630383186cb77bbed10bf1bf608482f51530b0a4917d0333936e2ad |
|
MD5 | 34d3c7f1d7ea9012fec7f70c4c57cf62 |
|
BLAKE2b-256 | 02f5a0bb8f1660a30730e2283d955e1e5ae89dc433f5387e58083465b7ff0aa2 |
Close
Hashes for goodreads_user_scraper-1.2.0-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 357d27cb67425e89232310650be2513eac5dbb292aeea8826a239aa8fa79c212 |
|
MD5 | 33e4ba0ab01a0012da95b9d8b5e14fb8 |
|
BLAKE2b-256 | b6d8d7e5473ebf529d6d481959b58b2885c9e7d42890b5dbecfbc0b761887680 |