Crawl your personal favorite images, photo albums, comics from website. Support pixiv, yande.re for now.
Project description
FavoritesCrawler
Crawl your personal favorite images, photo albums, comics from website.
Plan to support:
- pixiv.net (crawl your bookmarks for illust)
- yande.re (crawl posts that you voted)
- immpic.com (crawl your favorites for albums)
- instagram.com
- nhentai.net
Already support:
- pixiv.net (must login), Thanks for project PixivPy.
- yande.re (must login, only input your username)
- lmmpic.com (must login)
Requirements
- Python3.6+
Install
pip install favorites_crawler
Config Proxy (Optional)
# on Windows
set https_proxy=http://localhost:8080 # replace with your proxy server
# on Liunx/macOS
export https_proxy=http://localhost:8080
Login
favors login [-h] {pixiv,yandere,lemon}
Login Pixiv
Thanks for @ZipFile Pixiv OAuth Flow
- run command
favors login pixiv
- input your user_id (Access your pixiv personal page, copy from address bar), after press Enter, Pixiv login page will open in browser.
- Open dev console (F12) and switch to network tab.
- Enable persistent logging ("Preserve log").
- Type into the filter field: callback?
- Proceed with Pixiv login.
- After logging in you should see a blank page and request that looks like this: https://app-api.pixiv.net/web/v1/users/auth/pixiv/callback?state=...&code=.... Copy value of the code param into the prompt and hit the Enter key.
Login Yandere
- run command:
favors login yandere
- input your username and hit the Enter key.
Login Lmmpic
- run command:
favors login lemon
- input your username and hit the Enter key.
- input your password and hit the Enter key.
Login NHentai
- Open nhentai on browser and login.
- Use "Get cookies.txt" extension download cookie file.
- Copy cookie file to {user_home}/.favorites_crawler.
Crawl
Crawl Pixiv
Before run this command, make sure you are already login.
favors crawl pixiv
Crawl Yandere
Before run this command, make sure you are already login.
favors crawl yandere
Crawl Lmmpic
Before run this command, make sure you are already login.
favors crawl lemon
Crawl NHentai
Before run this command, make sure you are already login.
favors crawl nhantai
Crawl All Support Site
favors crawl all
Config
config file locate on {your_home}/.favorites_crawler/config.yml
.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
favorites_crawler-0.0.5.tar.gz
(12.7 kB
view hashes)
Built Distribution
Close
Hashes for favorites_crawler-0.0.5-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 6c220634fb6a8ff78386dd925b0cc631eb613ec32de78aaf0a4809006a0c91b5 |
|
MD5 | f908c4ce82b9ddb0c8254c4960e63be3 |
|
BLAKE2b-256 | 57293fa99ba92c7d0e30ab88db55e3adbddf906d6f9595871a7b5034dac10101 |