AgentLogs

ℹ️ Note: This package contains the schema v1.0, which only works with dataset releases 1.0-xxxxxxxx

Dataset releases | Changelog

TypedDict schema and helpers for the AgentLogs dataset. Field-level documentation: schema reference.

Installation

pip install risenlab-agentlogs huggingface_hub pyarrow

Usage

from pathlib import Path
from typing import cast

import pyarrow.parquet as pq
from huggingface_hub import snapshot_download
from agentlogs.schema import AgentSession, assert_dataset_version

# Full dataset into data/dataset/; existing files are skipped
dataset_path = Path("data") / "dataset"
snapshot_download(
    repo_id="risenlab/agentlogs",
    repo_type="dataset",
    revision="1.0-xxxxxxxx",
    local_dir=dataset_path,
)
# Fail if the snapshot schema does not match this package
assert_dataset_version(dataset_path)

# First session row, typed as AgentSession (nested fields included)
session_file = next((dataset_path / "agent_sessions").glob("*.parquet"))
session = cast(
    AgentSession,
    pq.read_table(session_file, memory_map=False).slice(0, 1).to_pylist()[0],
)
print(session["id"], session["name"])