yugioh-scraper 0.1.0

Yu-Gi-Oh! Scraper is a project that crawls websites and APIs and extracts Yu-Gi-Oh! related data from their pages.

Yu-Gi-Oh! Scraper

Yu-Gi-Oh! Scraper is a project that crawls websites and APIs and extracts Yu-Gi-Oh! related data from their pages.

Sources

• Yu-Gi-Oh! Card Database (db_yugioghcard)

Flowcharts

These flowcharts represent a workflow of each source of the project.

Yu-Gi-Oh! Card Database

graph LR
    Products(Get All Products)-->RemoveProductDuplicates[[Remove Duplicate Product By Name]]
    RemoveProductDuplicates-->ProductCard(Get All Cards)
    ProductCard-->RemoveCardDuplicates[[Remove Duplicate Cards By Name]]
    RemoveCardDuplicates-->Cards(Get Card Details)

Entity Relationship Diagrams

These entity–relationship model (or ER model) describes interrelated things of interest of each source of the project.

Yu-Gi-Oh! Card Database

erDiagram
    PRODUCTS {
        string product_type
        string product_name
        string data_type
    }
    PRODUCTS ||--|{ CARDS : contains
    CARDS {
        string card_name
        string card_rarity
        list card_details
        string product_name
        string product_release_date
        string data_type
    }

Getting Started

These instructions will get you a copy of the project up and running on your local machine for development and testing purposes.

Prerequisites

Requirements for the software and other tools to build, test and push

Installing

I strongly recommend that you install this project in a dedicated virtual environment to avoid conflicting with your system packages.

See Virtual Environments and Packages on how to create and use your virtual environment.

Use the package manager pip to install the requirements of this project.

python -m pip install -r requirements.txt

Built With

• Black - An uncompromising Python code formatter
• Scrapy - A fast high-level web crawling and web scraping framework

Contributing

Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.

Versioning

We use Semantic Versioning for versioning. For the versions available, see the tags on this repository.

Authors

• Albert Marrero - Provided Initial Code

See also the list of contributors who participated in this project.

Support

If you enjoy this repository, please star this repository. By starring a repository, it shows appreciation to the repository maintainer for their work. Many of GitHub's repository rankings depend on the number of stars a repository has.

License

This project is licensed under the MIT License - see the LICENSE.md file for details