pyfastyaml 0.1.0b4

Fast YAML parser for Python with C++/SIMD backend

pyfastyaml

pyfastyaml — Fast YAML parser for Python with C++/SIMD backend. 100–300× faster than PyYAML and ruamel.yaml. API compatible with PyYAML for typical config use cases (Kubernetes, Ansible, CI, Docker Compose).

Features

• High performance: C++17 implementation with AVX2 SIMD on x86 — orders of magnitude faster than pure-Python parsers
• PyYAML compatible API: loads(s), load(fp), load_all(s), dump(), dump_all() — drop-in replacement for config loading
• Types: dict, list, str, int, float, bool, null, nested structures
• Indentation: 2-space (preferred), 4-space, tabs
• Flow syntax: [a, b, c], {a: 1, b: 2} (incl. nested)
• Multiline strings: | (literal), > (folded)
• Anchors and aliases: &anchor, *alias
• Merge key: <<: *anchor and <<: [*a, *b]
• Document markers: ---, ..., %YAML directive

Installation

pip install pyfastyaml

Requires Python 3.10+ and a C++ compiler with C++17 support.

Usage

import pyfastyaml

# Parse string
data = pyfastyaml.loads("""
key: value
nested:
  inner: 42
items:
  - a
  - b
""")
# {'key': 'value', 'nested': {'inner': 42}, 'items': ['a', 'b']}

# Parse file (path or file-like object)
data = pyfastyaml.load("config.yaml")

# Serialize to YAML
yaml_str = pyfastyaml.dump(data)
pyfastyaml.dump(data, stream=open("out.yaml", "w"))

API matches PyYAML for common cases:

# Drop-in replacement
import pyfastyaml as yaml  # instead of import yaml
data = yaml.loads(yaml_string)
data = yaml.load("config.yaml")

Benchmark

Parsing time (μs, lower is better):

Size	pyfastyaml	PyYAML	ruamel	pyfastyaml vs PyYAML
Small (~200 B)	~2	~229	~377	~112× faster
Medium (~1.5 KB)	~7	~1,034	~1,777	~141× faster
Large (~15 KB)	~66	~11,153	~19,040	~170× faster
Realworld	~5	~841	~1,544	~161× faster

Run benchmarks:

pip install pytest-benchmark PyYAML ruamel.yaml
pytest tests/test_benchmark.py -v --benchmark-only

PyYAML Compatibility

pyfastyaml produces the same result as yaml.safe_load() for block-style YAML typical of configs. Compatibility tests included in tests/test_pyyaml_compat.py.

Serialization (dump)

# Single document
yaml_str = pyfastyaml.dump({"a": 1, "b": [1, 2, 3]})

# Write to file (path or stream)
pyfastyaml.dump(data, "output.yaml")
pyfastyaml.dump(data, stream=open("out.yaml", "w"))

# Deterministic output (sorted keys)
yaml_str = pyfastyaml.dump(data, sort_keys=True)

# Multiple documents
yaml_str = pyfastyaml.dump_all([{"a": 1}, {"b": 2}])

Multi-document streams

docs = pyfastyaml.load_all("""
---
a: 1
---
b: 2
""")
# [{'a': 1}, {'b': 2}]

Limitations

Not yet supported:

• Custom tags
• Complex flow keys (? syntax)

Development

pip install -e ".[dev]"
python setup.py build_ext --inplace
pytest tests/

Benchmark commands:

pytest tests/test_benchmark.py -v --benchmark-only
pytest tests/test_benchmark.py -v --benchmark-only --benchmark-autosave
pytest tests/test_benchmark.py -v --benchmark-only --benchmark-compare

Publishing (maintainers)

pip install build twine
python -m build
python -m twine upload dist/*

License

MIT