Skip to main content

ASTx is an agnostic expression structure for AST.

Project description

ASTx: Abstract Syntax Tree Framework

CI Python Versions Package Version License Discord

ASTx is a versatile and extensible library for representing, manipulating, and analyzing Abstract Syntax Trees (ASTs). It provides a unified interface for working with ASTs in various contexts, such as compilers, interpreters, and transpilers.

ASTx makes it easy to model programming languages, apply transformations, generate code, and build custom tools for static and dynamic analysis.

ASTx doesn't aim to be a lexer or a parser, although it could be used by any programming language or parser in order to provide a high level representation of the AST.

It integrates with IRx, enabling code generation with LLVM. Currently, only a small subset of ASTx nodes is supported, but active development is underway, with full support expected soon.

Note: this project is under active development and it is not ready for production yet.


🚀 Features

  • Language-Agnostic Design: Model and manipulate ASTs for different programming languages.
  • Extensibility: Easily add support for new language features or custom AST nodes.
  • Code Generation: Transform ASTs into target code for various backends or target languages.
  • Rich Node Set: Support for common constructs like variables, expressions, functions, classes, and control flow.
  • Python Integration: Built with Python, making it easy to integrate into Python-based projects.
  • Symbol Table: Support for an initial implementation of Symbol Table.

📦 Installation

Install ASTx from PyPI:

pip install astx

For ASCII visualization in the console (via mermaid-ascii), install with the console extra:

pip install 'astx[console]'

Or install all optional dependencies:

pip install 'astx[all]'

📖 Overview

ASTx is designed around two primary concepts:

  1. Nodes: Each node represents a language construct (e.g., Variable, Function, IfStmt).
  2. Tree: Nodes are organized hierarchically, forming an abstract representation of the program structure.

Additionally, ASTx provides a simple transpiler for converting ASTx nodes to Python code (in text format). This feature is intended solely for educational purposes, demonstrating how a transpiler from ASTx to any other language can be implemented.


✨ Usage

1. Create an AST

import astx

# Define a simple function `add(x, y): return x + y`
args = astx.Arguments(
    astx.Argument(name="x", type_=astx.Int32()),
    astx.Argument(name="y", type_=astx.Int32()),
)
fn_body = astx.Block()
fn_body.append(
    astx.FunctionReturn(
        value=astx.BinaryOp(op_code="+", lhs=astx.Variable("x"), rhs=astx.Variable("y"))
    )
)
add_function = astx.FunctionDef(
    prototype=astx.FunctionPrototype(name="add", args=args, return_type=astx.Int32()),
    body=fn_body,
)

2. Generate Code

Use a transpiler to convert the AST to Python code:

from astx_transpilers.python_string import ASTxPythonTranspiler

# Transpile the AST to Python
transpiler = ASTxPythonTranspiler()
python_code = transpiler.visit(add_function)

print(python_code)

Output:

def add(x: int, y: int) -> int:
    return (x + y)

3. ASTx Visualization Features

ASTx offers multiple ways to visualize the AST structure:

  • YAML
  • JSON
  • Graphical visualization (PNG or ASCII)

In a Jupyter Notebook, the default graphical visualization is PNG, while in a console, the default is ASCII (requires pip install 'astx[console]'). Without the console extra, console output falls back to YAML.

You can also print the AST structure in JSON or YAML format. For example:

>>> print(add_function.to_json())
>>> print(add_function.to_yaml())

Transpilers

ASTx includes a powerful transpiler system to convert your AST structures into executable Python code. This is great for code generation, prototyping, or building custom language tools.

from astx_transpilers.python_string import ASTxPythonTranspiler

# Using the 'add_function' ASTx node from the example above
transpiler = ASTxPythonTranspiler()
python_code = transpiler.visit(add_function)
print(python_code)

Output:

def add(x: int, y: int) -> int:
    return (x + y)

For a deep dive into the architecture and more hands-on examples, check out the full transpiler tutorial.


📚 Documentation

Detailed documentation and examples can be found in the official documentation.


🛠️ Contributing

Contributions are welcome! Please check out our Contributing Guide for more information.


📝 License

ASTx is open-source software licensed under the BSD-3-Clause License. See LICENSE for details.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

astx-1.23.1.tar.gz (50.5 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

astx-1.23.1-py3-none-any.whl (73.6 kB view details)

Uploaded Python 3

File details

Details for the file astx-1.23.1.tar.gz.

File metadata

  • Download URL: astx-1.23.1.tar.gz
  • Upload date:
  • Size: 50.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.3.4 CPython/3.10.20 Linux/6.17.0-1010-azure

File hashes

Hashes for astx-1.23.1.tar.gz
Algorithm Hash digest
SHA256 e773c39c8f26b3f52f4b890e898efb17498c8affae389822780e0f5895725d99
MD5 a3ec48686e8fd9b3755a7caee4847c3a
BLAKE2b-256 208a0a8813b1c016394dddc47bc3e8dff2c8bcccf284079b46e7258aaaa476c5

See more details on using hashes here.

File details

Details for the file astx-1.23.1-py3-none-any.whl.

File metadata

  • Download URL: astx-1.23.1-py3-none-any.whl
  • Upload date:
  • Size: 73.6 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.3.4 CPython/3.10.20 Linux/6.17.0-1010-azure

File hashes

Hashes for astx-1.23.1-py3-none-any.whl
Algorithm Hash digest
SHA256 970e0698b95a3fec8e6f166761ff80a51b4fca8063ef4642640138f318e7475b
MD5 f1b68cc746d61709af060e8ae4dbfe3c
BLAKE2b-256 1863ac3e10a5e429653b8759ae170b22af2a2afb2eaa0b37df0e4f20e683de65

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page