GeoLIPI: A DSL for Implicit Geometric Modelling
GeoLIPI is a Language for modelling 2D/3D geometric objects. This is to be treated as a meta-language, from which visual programming languages can be derived. Some of the languages/visual programs that can be executed in this framework are:
- CSG 3D Variants
- GeoCode
- SVG 2D
and many more. Check out languages.md for more details. The banner image shows ome of the highlights:
- (top-left) Execute and render 3D Geometric expressions in Blender.
- (top-right) Different 2D and 3D types of data that can be generated with GeoLIPI.
- (mid-left) Batched Execution of expressions - speedy data generation.
- (lower) Parameter Optimization for a 3D target shape.
- (bottom) Parameter Optimization for 2D shapes.
This repository acts as the backbone for some other DSLs: SplitWeave, CISL
Important: Research Code - Use at your own risk
I have added some documentation (with the help of ChatGPT) here.
Main usecase
Mainly, GeoLIPI attempts to embed a generic visual language in python, making it easier to use and extend for research. Additionally, it provides the following benefits:
- Fast Batched Execution of programs - useful for training neural networks on large batches of program executions. See a demonstration of this in
notebooks/compiled_execution.ipynb. - Single "symbolic" object, multiple execution strategies. This helps with "executing" the program in different platforms/systems (such as blender for rendering, and pytorch for optimization). See
scripts/blender_render_example.py. - Parameter Optimization of arbitrary visual programs (All operations allow differentiable optimization of its parameters). See
notebooks/parameter_optimization.ipynb. - [TBD] Help with searching programs for a desired execution (refer to our recent paper).
- Batched PyTorch execution code for all the shader toy 2D and 3D primitives described by Inigo Quilez. See
notebooks/torch_sdf2d_example.ipynbandnotebooks/torch_sdf3d_example.ipynb.
Installation
From PyPI (recommended)
GeoLIPI is published as a Python package:
pip install geolipi
This installs the core symbolic language and PyTorch execution backend.
From source
git clone https://github.com/BardOfCodes/geolipi.git
cd geolipi
# Optional: create and activate a virtual environment
pip install -r requirements.txt
pip install -e .
For development (tests, linting): pip install -e ".[dev]".
Quickstart example
Here is a basic example of using the language to create an SVG-like image:
import matplotlib.pyplot as plt
# geolipi.symbolic contains the "language" itself - disentangled from its evaluation/execution.
import geolipi.symbolic as gls
from geolipi.torch_compute import recursive_evaluate, Sketcher
# sketcher is used for creating position grids
resolution = 1024
sketcher_2d = Sketcher(device="cuda", resolution=resolution, n_dims=2)
device = "cuda"
# Create a complex SVG shape
# Each star is s Star with a star5 on a reg star
star_expression = gls.ApplyColor2D(
gls.Star2D((0.7,),(0.25,)), sp.Symbol("burgundy"))
star_reg_expression = gls.ApplyColor2D(
gls.RegularStar2D((0.5,), (12.,), (5.,)), sp.Symbol("lilac"))
circle_expr = gls.ApplyColor2D(
gls.Circle2D((0.15,)), sp.Symbol("chartreuse"))
mix_expr = gls.SourceOver(circle_expr,
gls.SourceAtop(star_expression, star_reg_expression))
# Convert to pytorch tensors for evaluation
# mix_expr.tensor()
output = recursive_evaluate(mix_expr.tensor(), sketcher_2d)
image = output.reshape(res, res, 4).detach().cpu().numpy()
# Show image.
plt.figure(figsize=(10, 10))
plt.imshow(image)
plt.axis('off')
This results in an image like:
Here is an example of optimizing such expressions. Check out other examples in notebooks/.
Remaining TODOs
- 3D data DiffOpt with primitive soup.
High level issues
-
Execution time. Something like a BVH is a must for really complex programs.
-
Initialization time - Sympy Functions are not the simplest to initialize. Furthermore, the lookup_table for tensors is not the most efficient.
-
What to do about numerical precision? Also SDFs are almost often not exact (after boolean operations or scaling etc.)
-
Aliasing - If we want beautiful output images, we need to do something about aliasing. This is supported in the SplitWeave repository.
-
Which symbols should have 2D/3D explicit and which ones not? The code can be made more uniform in general.
Other related works
Many other awesome libraries exist which help with pythonic 3D modelling. I have taken inspiration from many of them. Some of them are:
Acknowledgements
- A big shoutout to Inigo Quilez for his awesome work on SDFs and shader toy.
- Thanks to Carson Katri for his geometry script work which helped with the blender side of things.
- Derek's Blender toolbox (link) was quite helpful for materials.
- Patrick-Kidger's sympytorch helped thinking about how to integrate sympy here.
- Thanks to Tim Nelson's Logic for Systems course made the DNF/CNF stuff much easier to understand.
- Thanks to my PhD Advisor Daniel Ritchie for his support and guidance.
- Thanks to my lab mates Arman Maesumi and R. Kenny Jones for their feedback.
- Hiroki Sakuma's Torch-Sphere-Tracer helped write my tiny dirty sphere tracer.
Naming
GeoLIPI stands for Geometry-Lipi. Lipi is a Hindi Language term which stands for "script" (So, Geometry-Script basically). Also, the abbreviation gls for geolipi.symbolic (which contains all the sympy expressions etc.) is inspired by OpenGL Shading Language's abbreviation glsl.
Metadata
Release files for geolipi 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| geolipi-0.1.0.tar.gz | 5.0 MB | Without provenance | Details for geolipi-0.1.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| geolipi-0.1.0-py3-none-any.whl | Python 3 | none | any | Details for geolipi-0.1.0-py3-none-any.whl |
Total release size: 5.1 MB
Release files / geolipi-0.1.0.tar.gz
| Download URL | geolipi-0.1.0.tar.gz |
|---|---|
| Size | 5.0 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
f9c3316a1cf8249abd6de5f31b345111b62631b9a40bb665af8f1031be0bcf32
|
|
BLAKE2b-256 checksum How to use checksums |
7b9c8feea1a0af1e65626fae4ad1767acfb029bc2ff8ded2f1cb49fc3c551cdf
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.14
|
Release files / geolipi-0.1.0-py3-none-any.whl
| Download URL | geolipi-0.1.0-py3-none-any.whl |
|---|---|
| Size | 133.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
d7822b100744ba736204b91d1efbd907c5845a2e07357b6aa18469d0c1473621
|
|
BLAKE2b-256 checksum How to use checksums |
0c27d0b8f445c051d220a84a8a601d05a84861d276ee44c3c8adb539e7b099bd
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/6.2.0 CPython/3.11.14
|
Security for geolipi 0.1.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.