Skip to main content

MyAnimeList web scraper

Project description

MyAnimeList web scraper is a Python library for gathering data for analysis.

Installation & Usage

Installation is simple:

pip install mal-scraper

Please use the documentation for the reference and usage examples.

For your convenience follow Semantic Versioning.

Development

Please see the Contributing documentation page for full details, and especially look at the tips section.

After cloning, and creating a virtualenv, install the development dependencies:

pip install -e .[develop]

To run the all tests, skipping the python interpreters you don’t have:

tox --skip-missing-interpreters

Project Notes:

  • Tests will always mock requests to the internet. You can set the environment variable LIVE_RESPONSES=1 to properly test web scraping.

  • You can look at coverage results inside htmlcov/index.html.

Note, to combine the coverage data from all the tox environments run:

Windows

set PYTEST_ADDOPTS=--cov-append
tox

Other

PYTEST_ADDOPTS=--cov-append tox

Changelog

0.3.0 (2017-05-02)

  • Fix various issues on anime pages

  • Rename retrieve_anime to get_anime for consistency (backwards-incompatible)

0.2.1 (2017-05-01)

  • Add Season as an Enum rather than a simple string (backwards-incompatible)

  • Fix failing tests due to version number

0.2.0 (2017-05-01)

  • Alter anime retrieval API to use exceptions (backwards-incompatible)

  • Improve documentation (mainly around the anime API)

0.1.0 (2016-05-15)

  • First release on PyPI.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mal-scraper-0.3.0.tar.gz (288.8 kB view hashes)

Uploaded source

Built Distribution

mal_scraper-0.3.0-py2.py3-none-any.whl (14.5 kB view hashes)

Uploaded 3 5

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page