Skip to main content

Python library to process solo queue game data with comprehensive database models to additionally store LoL Esports data

Project description

ATG - All The Games

Opinionated but flexible library of database models and scripts and APIs to store solo queue / competitive games, player, team and game data tailored for LoL Esports.

Features

  • Functions to access Riot & GRID APIs with smart region handling
  • SQLAlchemy database models compatible with both solo queue & esports games
  • Database models to store riot game event JSONL files
  • Ability to store complete Match-V5 JSON objects
  • Scripts to insert/manage solo queue accounts & store new solo queue games

1.X Release Notes

As of version 1.X, PostgreSQL is the required database backend due to the use of JSONB columns which are declared using the sqlalchemy.dialects.postgresql.JSONB datatype.

I have decided to bump the major version since this library is mature enough for my production needs however expect extensive schema changes as I look to fully mature my database models.

Although naming initially reflects the match-v5 API's choices and the terminology used by GRID esports, I've had to make some changes.

Here is are the major differences / exceptions that should be noted.

Key used Meaning Examples
Series A collection of related games A series has many games
source_data Raw/unprocessed/additional data Specifically in ParticipantStats we store the unprocessed match_v5 columns here
X_id table_id; Foreign key name champion_id, game_id
team_id Blue / red sides 100 - Blue, 200 - Red
participant_id The "#" of the participant From 1 - 10 representing blue top -> red bottom most of the time.

Todo

  • Remove the usage of ratelimit in favor of something that actually does stable rate limiting
  • Properly handle API error codes
  • Add the ability to store draft / other available esports game information
  • Open source GRID API code and GRID insertion scripts
  • Handle database sessions and API keys better using dependency injection or something other than passing session objects around. I kind of like the current functional nature of the API
  • Normalize database objects. Specifically the series/tournament-game relationship
  • Reduce the number of nullable columns where possible. This is especially a problem on the game table
  • Introduce enums where appropriate
  • Transition to HTTPX > requests
  • Remove or update the player_team_association table. I currently don't use it but it's definitely useful and should be revisited in the future.

Setup & Example Usage

It is recommended to use a virtual environment when directly running this library's scripts.

Setup dependencies

pip install -r requirements.txt

Edit the .env file with your Riot API key and database connection string. The psycopg3 database driver is installed if this code is installed as a library and is recommended.

python main.py

Example usage (linking a pro player by name to a solo queue account)

import os
from sqlalchemy import select

from ATG.database import get_session_factory
from ATG.api import get_account_by_riot_id
from ATG.models import Player, Account

RIOT_API = os.environ["RIOT_API"]
Session = get_session_factory(os.environ["PROD_DB"])

def link_pro(pro_name, soloq):
    with Session() as session:
        try:
            player = session.execute(select(Player).where(Player.name == pro_name)).scalar_one()
        except:
            print(f"Unable to find associated player for {pro_name}")
            return
        name, tagline = soloq.split("#")
        details = get_account_by_riot_id(name, tagline, RIOT_API).json()
        new_acc = Account(puuid=details['puuid'], name=details['gameName'], tagline=details['tagLine'], region='NA1', player_id=player.id)
        session.add(new_acc)
        try:
            session.commit()
            print(f"Linked {pro_name} with {name}#{tagline}")
        except:
            session.rollback()
            print(f"Account {name}#{tagline} already linked")

link_pro("Tactical", "Tactical0#NA1")

Schema changes - Alembic commands

In the case of schema changes, Alembic allows us to automatically generate a script to apply the changes to the database. When a commit will cause a schema change, an alembic script should be attached to the commit.

alembic revision --autogenerate -m "changes"
alembic upgrade head

Poetry

Commands to publish updates on PyPi

poetry build
poetry publish

Legal

ATG is not endorsed by Riot Games and does not reflect the views or opinions of Riot Games or anyone officially involved in producing or managing Riot Games properties. Riot Games and all associated properties are trademarks or registered trademarks of Riot Games, Inc

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

atg_lib-1.5.3.tar.gz (30.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

atg_lib-1.5.3-py3-none-any.whl (42.8 kB view details)

Uploaded Python 3

File details

Details for the file atg_lib-1.5.3.tar.gz.

File metadata

  • Download URL: atg_lib-1.5.3.tar.gz
  • Upload date:
  • Size: 30.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.12.3 Linux/6.11.0-29-generic

File hashes

Hashes for atg_lib-1.5.3.tar.gz
Algorithm Hash digest
SHA256 3cbd1a3e555060219d4980767a1662eace814fcaf781ab4f4744a56a29376310
MD5 eef58549e632f980f220d4055614ec2e
BLAKE2b-256 222be00645b06b265db40fd296026e7c65ec9466a7128be36c844850564ecac0

See more details on using hashes here.

File details

Details for the file atg_lib-1.5.3-py3-none-any.whl.

File metadata

  • Download URL: atg_lib-1.5.3-py3-none-any.whl
  • Upload date:
  • Size: 42.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.12.3 Linux/6.11.0-29-generic

File hashes

Hashes for atg_lib-1.5.3-py3-none-any.whl
Algorithm Hash digest
SHA256 a8177b0fe9590fa7780184680307e84cddfe6b78b76f24116fe65ddc9345764f
MD5 f8416262ba04228b29200bec26955ec1
BLAKE2b-256 4ce1f00843b262c2c77f92482166dd53d71b289c7ad495303047b4f6960cef2a

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page