Skip to main content

Python library to process solo queue game data with comprehensive database models to additionally store LoL Esports data

Project description

ATG - All The Games

Opinionated but flexible library of database models and scripts and APIs to store solo queue / competitive games, player, team and game data tailored for LoL Esports.

Features

  • Functions to access Riot & GRID APIs with smart region handling
  • SQLAlchemy database models compatible with both solo queue & esports games
  • Database models to store riot game event JSONL files
  • Ability to store complete Match-V5 JSON objects
  • Scripts to insert/manage solo queue accounts & store new solo queue games

1.X Release Notes

As of version 1.X, PostgreSQL is the required database backend due to the use of JSONB columns which are declared using the sqlalchemy.dialects.postgresql.JSONB datatype.

I have decided to bump the major version since this library is mature enough for my production needs however expect extensive schema changes as I look to fully mature my database models.

Although naming initially reflects the match-v5 API's choices and the terminology used by GRID esports, I've had to make some changes.

Here is are the major differences / exceptions that should be noted.

Key used Meaning Examples
Series A collection of related games A series has many games
source_data Raw/unprocessed/additional data Specifically in ParticipantStats we store the unprocessed match_v5 columns here
X_id table_id; Foreign key name champion_id, game_id
team_id Blue / red sides 100 - Blue, 200 - Red
participant_id The "#" of the participant From 1 - 10 representing blue top -> red bottom most of the time.

Todo

  • Remove the usage of ratelimit in favor of something that actually does stable rate limiting
  • Properly handle API error codes
  • Add the ability to store draft / other available esports game information
  • Open source GRID API code and GRID insertion scripts
  • Handle database sessions and API keys better using dependency injection or something other than passing session objects around. I kind of like the current functional nature of the API
  • Normalize database objects. Specifically the series/tournament-game relationship
  • Reduce the number of nullable columns where possible. This is especially a problem on the game table
  • Introduce enums where appropriate
  • Transition to HTTPX > requests
  • Remove or update the player_team_association table. I currently don't use it but it's definitely useful and should be revisited in the future.

Setup & Example Usage

It is recommended to use a virtual environment when directly running this library's scripts.

Setup dependencies

pip install -r requirements.txt

Edit the .env file with your Riot API key and database connection string. The psycopg3 database driver is installed if this code is installed as a library and is recommended.

python main.py

Example usage (linking a pro player by name to a solo queue account)

import os
from sqlalchemy import select

from ATG.database import get_session_factory
from ATG.api import get_account_by_riot_id
from ATG.models import Player, Account

RIOT_API = os.environ["RIOT_API"]
Session = get_session_factory(os.environ["PROD_DB"])

def link_pro(pro_name, soloq):
    with Session() as session:
        try:
            player = session.execute(select(Player).where(Player.name == pro_name)).scalar_one()
        except:
            print(f"Unable to find associated player for {pro_name}")
            return
        name, tagline = soloq.split("#")
        details = get_account_by_riot_id(name, tagline, RIOT_API).json()
        new_acc = Account(puuid=details['puuid'], name=details['gameName'], tagline=details['tagLine'], region='NA1', player_id=player.id)
        session.add(new_acc)
        try:
            session.commit()
            print(f"Linked {pro_name} with {name}#{tagline}")
        except:
            session.rollback()
            print(f"Account {name}#{tagline} already linked")

link_pro("Tactical", "Tactical0#NA1")

Schema changes - Alembic commands

In the case of schema changes, Alembic allows us to automatically generate a script to apply the changes to the database. When a commit will cause a schema change, an alembic script should be attached to the commit.

alembic revision --autogenerate -m "changes"
alembic upgrade head

Poetry

Commands to publish updates on PyPi

poetry build
poetry publish

Legal

ATG is not endorsed by Riot Games and does not reflect the views or opinions of Riot Games or anyone officially involved in producing or managing Riot Games properties. Riot Games and all associated properties are trademarks or registered trademarks of Riot Games, Inc

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

atg_lib-1.5.2.tar.gz (30.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

atg_lib-1.5.2-py3-none-any.whl (42.8 kB view details)

Uploaded Python 3

File details

Details for the file atg_lib-1.5.2.tar.gz.

File metadata

  • Download URL: atg_lib-1.5.2.tar.gz
  • Upload date:
  • Size: 30.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.12.3 Linux/6.11.0-29-generic

File hashes

Hashes for atg_lib-1.5.2.tar.gz
Algorithm Hash digest
SHA256 3d216adf846da74bfd0c82adf2213b134174508a5ff64523e4cd6927ae8da40a
MD5 aaf0f52f266a6d1ffde8f6bf5878dc49
BLAKE2b-256 9f9e93d72eb34a8c16f09ff76dbb65a2cfcbf38ebe82738e4cc893f2e463a565

See more details on using hashes here.

File details

Details for the file atg_lib-1.5.2-py3-none-any.whl.

File metadata

  • Download URL: atg_lib-1.5.2-py3-none-any.whl
  • Upload date:
  • Size: 42.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.3 CPython/3.12.3 Linux/6.11.0-29-generic

File hashes

Hashes for atg_lib-1.5.2-py3-none-any.whl
Algorithm Hash digest
SHA256 46de376b70a6dffc8ecaff4889492363bca2e77079d93f9358c91bbdde0f54a8
MD5 1417f6be5333437d4bd59c97711aba17
BLAKE2b-256 97a6c923bc5145187389ee04c2000631ac2348181f5b8c2c8ce9bf71c4c9dcd1

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page