Skip to main content

run SQL queries on JSON data

Project description

abstra-json-sql

abstra-json-sql is a Python library that allows you to run SQL queries on JSON data. It is designed to be simple and easy to use, while providing powerful features for querying and manipulating JSON data.

[!WARNING]
This project is in its early stages and is not yet ready for production use. The API may change, and there may be bugs. Use at your own risk.

Installation

You can install abstra-json-sql using pip:

pip install abstra-json-sql

Usage

Command Line Interface

Assuming you have a directory structure like this:

.
├── organizations.json
├── projects.json
└── users.json

Querying Data

You can query the JSON files using SQL syntax. For example, to get all users from the users file, you can run:

abstra-json-sql "select * from users"

Or using the explicit query subcommand:

abstra-json-sql query --code "select * from users"

This will return all the users in the users.json file.

Interactive Mode

You can also run the CLI in interactive mode:

abstra-json-sql

This will start an interactive SQL prompt where you can type queries and see results immediately.

Creating Tables

You can create new tables interactively using the create table command:

abstra-json-sql create table --interactive

This will guide you through the process of creating a new table by asking for:

  • Table name
  • Column names and types (int, string, float, bool)
  • Primary key designation
  • Default values

The interactive table creation supports:

  • Column types: int, string, float, bool
  • Primary keys: Mark columns as primary keys during creation
  • Default values: Set default values for columns
  • Validation: Prevents duplicate table/column names and validates data types

Output Formats

You can specify the output format using the --format option:

abstra-json-sql "select * from users" --format csv
abstra-json-sql "select * from users" --format json

Python API

You can also use abstra-json-sql in your Python code. Here's an example:

from abstra_json_sql.eval import eval_sql
from abstra_json_sql.tables import InMemoryTables, Table, Column

code = "\n".join(
    [
        "select foo, count(*)",
        "from bar as baz",
        "where foo is not null",
        "group by foo",
        "having foo <> 2",
        "order by foo",
        "limit 1 offset 1",
    ]
)
tables = InMemoryTables(
    tables=[
        Table(
            name="bar",
            columns=[Column(name="foo", type="text")],
            data=[
                {"foo": 1},
                {"foo": 2},
                {"foo": 3},
                {"foo": 2},
                {"foo": None},
                {"foo": 3},
                {"foo": 1},
            ],
        )
    ],
)
ctx = {}
result = eval_sql(code=code, tables=tables, ctx=ctx)

print(result) # [{"foo": 3, "count": 2}]

CLI Examples

Basic Query

# Query all records from a table
abstra-json-sql "SELECT * FROM users"

# Query with conditions
abstra-json-sql "SELECT name, email FROM users WHERE age > 25"

Interactive Table Creation

# Start interactive table creation
abstra-json-sql create table --interactive

# Example interaction:
# Table name: employees
# Column name: id
# Column type for 'id' (int/string/float/bool): int
# Is 'id' a primary key? (y/N): y
# Column name: name
# Column type for 'name' (int/string/float/bool): string
# Column name: salary
# Column type for 'salary' (int/string/float/bool): float
# Does 'salary' have a default value? (y/N): y
# Default value for 'salary': 0.0
# Column name: (press Enter to finish)

Output Formats

# JSON output (default)
abstra-json-sql "SELECT * FROM users" --format json

# CSV output
abstra-json-sql "SELECT * FROM users" --format csv

Working Directory

# Specify a different working directory
abstra-json-sql "SELECT * FROM users" --workdir /path/to/json/files

Features

  • SQL Queries on JSON: Run SQL queries directly on JSON files
  • Command Line Interface: Easy-to-use CLI with multiple output formats
  • Interactive Mode: Interactive SQL prompt for exploratory queries
  • Table Management: Create and manage tables interactively
  • Multiple Output Formats: Support for JSON and CSV output
  • Python API: Use the library programmatically in your Python projects

Supported SQL Syntax

  • WITH

    • RECURSIVE
  • SELECT

    • ALL
    • DISTINCT
    • *
    • FROM
      • JOIN
        • INNER JOIN
        • LEFT JOIN
        • RIGHT JOIN
        • FULL JOIN
        • CROSS JOIN
    • WHERE
    • GROUP BY
    • HAVING
    • WINDOW
    • ORDER BY
    • LIMIT
    • OFFSET
    • FETCH
    • FOR
  • INSERT

    • INTO
    • VALUES
    • DEFAULT
    • SELECT
    • RETURNING
  • UPDATE

  • DELETE

  • CREATE

    • TABLE (via interactive CLI)
  • DROP

  • ALTER

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

abstra_json_sql-0.0.10.tar.gz (34.2 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

abstra_json_sql-0.0.10-py3-none-any.whl (43.5 kB view details)

Uploaded Python 3

File details

Details for the file abstra_json_sql-0.0.10.tar.gz.

File metadata

  • Download URL: abstra_json_sql-0.0.10.tar.gz
  • Upload date:
  • Size: 34.2 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for abstra_json_sql-0.0.10.tar.gz
Algorithm Hash digest
SHA256 547d64cb246b399f8923692ba0d94d5b3a6ea92ecc5951601cd808028bd14e9c
MD5 18d2032cf69d119b11176167149272e9
BLAKE2b-256 6c903128abaf2d10abed6d1a901f14a1072a95f1318124221eb93ebbd2e7c268

See more details on using hashes here.

File details

Details for the file abstra_json_sql-0.0.10-py3-none-any.whl.

File metadata

File hashes

Hashes for abstra_json_sql-0.0.10-py3-none-any.whl
Algorithm Hash digest
SHA256 d2dadfd6d0942056d119d3609c3ac077a2f06022dc10d6b1c728cc3a91e21ae2
MD5 499c1b7055fe56f95941b3137959e31c
BLAKE2b-256 2b06fc024204fbda39f305ccd96664c56e4a4311508d270d605a14b5a1177e11

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page