Incremental View Maintenance for Python backends
Project description
stepping
Based on the paper: DBSP: Automatic Incremental View Maintenance for Rich Query Languages.
📚 Documentation 📚
Installation
pip install stepping
Development installation
git clone git@github.com:leontrolski/stepping.git
python -m venv .env
source .env/bin/activate
pip install -e '.[dev]'
pytest
mypy src tests
Todos
- Docs.
- Work out how to parallelize.
- Write everything up, email the dbsp people from the original paper. In particular, ask question about why the incremental recursive stuff is different from the paper.
- See suggestions in
performance.md
. - Look at 11.8 "Window aggregates"
- Replace
integrate_delay
with a nice transform. Similarly, transform shared delays. - Test arbitrary depth grouped nesting and joining in a grouped setting (Does this need doing?).
- Replace
annotate_zset
with__get_pydantic_core_schema__
. - Revisit
st.compile(...)
Uploading to Pypi
# bump version
python -m pip install build twine
python -m build
twine check dist/*
twine upload dist/*
Deploy docs
flyctl launch
flyctl deploy
flyctl ips list -a stepping-docs
# set A record to @, IPv4
# set AAAA record to @, IPv6
flyctl certs create -a stepping-docs stepping.site
cd docs/doks
npm install
npm run start
npm run build
cd ..; flyctl deploy; cd -
cd docs
python ../scripts/md.py ../ $(find -L ../docs-md -name '**.md')
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
stepping-0.0.2.tar.gz
(44.4 kB
view hashes)
Built Distribution
stepping-0.0.2-py3-none-any.whl
(44.5 kB
view hashes)