MangaCrawler 1.0.0a3

Crawler for finding manga to read.

Simple crawler for finding new chapters to read.

1. Reads mangalist file for supported list site.

2. Finds all of the mangas that has 5 or more new chapters from supported manga sites.

3. Outputs .csv file with all of the needed data.

Installing and usage

Installing

1. Install python3 and pip.

2. Install with pip or Build from source.

   • Install with pip:

     • pip install MangaCrawler

   • Build from source:

     • git clone https://github.com/SanteriHetekivi/MangaCrawler.git

     • cd MangaCrawler/

     • python setup.py install

Usage

1. Run the program with arguments

   • For example: MangaCrawler -f new -s mangafox -v -c 5 -m manga.xml

2. Will output result to CSV file. (HTML output is under development)

Arguments

Short	Long	Descripti on
-v		Print verbose status messages.
-h	–help	Print Help message.
-f	–find	Manga find mode to use. (new or updated) (-f upd ated)
-s	–site	Manga site to use. (-s man gafox)
-c	–min-c hapter s	Minimum amount of new chapters that manga has to have before it gets to output csv. (-c 5 )
-m	–manga -xml-f ile	MyAnimeLi st mangalist xml file. (-m man ga.xml) If NOT given and current directory has XML files, program gives a opportuni ty to choose from them.
-a	–azure -accou nt-key	API key for Bing Web Search API.
-o	–outpu t-file	File to put output on. If NOT given will make file to current directory .

Deployment information

Deploying

1. Install python3 and pip

2. Run command to build dependencies. pip install -r requirements.txt

3. Run the program

   • With output python manga-crawler.py -f updated -s mangafox -v

   • Without output python manga-crawler.py -f updated -s mangafox

Support and licenses

Supported List Sites

• MyAnimeList

Supported Manga Sites

• Manga Fox

Credits and license

• Made by Santeri Hetekivi, for his personal needs.

• This code is licensed under Apache License 2.0.