Skip to main content

Crawler for finding manga to read.

Project description

Simple crawler for finding new chapters to read.

  1. Reads mangalist file for supported list site.
  2. Finds all of the mangas that has 5 or more new chapters from supported manga sites.
  3. Outputs .csv file with all of the needed data.

Installing and usage

Installing

  1. Install python3 and pip.
  2. Install with pip or Build from source.
    • Install with pip:
      • pip install MangaCrawler
    • Build from source:
      • git clone https://github.com/SanteriHetekivi/MangaCrawler.git
      • cd MangaCrawler/
      • python setup.py install

Usage

  1. Run the program with arguments
    • For example: MangaCrawler -f new -s mangafox -v -c 5 -m manga.xml
  2. Will output result to CSV file. (HTML output is under development)

Arguments

Short Long Descripti on
-v   Print verbose status messages.
-h –help Print Help message.
-f –find Manga find mode to use. (new or updated) (-f upd ated)
-s –site Manga site to use. (-s man gafox)
-c –min-c hapter s Minimum amount of new chapters that manga has to have before it gets to output csv. (-c 5 )
-m –manga -xml-f ile MyAnimeLi st mangalist xml file. (-m man ga.xml) If NOT given and current directory has XML files, program gives a opportuni ty to choose from them.
-a –azure -accou nt-key API key for Bing Web Search API.
-o –outpu t-file File to put output on. If NOT given will make file to current directory .

Deployment information

Deploying

  1. Install python3 and pip
  2. Run command to build dependencies. pip install -r requirements.txt
  3. Run the program
    • With output python manga-crawler.py -f updated -s mangafox -v
    • Without output python manga-crawler.py -f updated -s mangafox

Support and licenses

Supported List Sites

Supported Manga Sites

Credits and license

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for MangaCrawler, version 1.0.0a3
Filename, size File type Python version Upload date Hashes
Filename, size MangaCrawler-1.0.0a3-py3.6.egg (51.2 kB) File type Egg Python version 3.6 Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page