jaxrenderer 0.1.3

Jax implementation of rasterizer renderer.

JAX Renderer

Key Difference from erwincoumans/tinyrenderer

• Native JAX implementation, supports jit, vmap, etc.
• Lighting is computed in main camera's eye space; while in PyTinyrenderer it is computed in world space.
• Texture specification is different: in PyTinyrenderer, the texture is specified in a flattened array, while in JAX Renderer, the texture is specified in a shape of (width, height, colour channels). A simple way to transform old specification to new specification is to use the convenient method build_texture_from_PyTinyrenderer.
• Rendering pipeline is different. PyTinyrenderer renders one object at a time, and share zbuffer and framebuffer across one pass. This renderer first merges all objects into one big mesh in world space, then process all vertices together, then interpolates and rasterise and render. For fragment shading, this is done by sweeping each row in a for loop, and batch compute all pixels together. For computing a pixel, all fragments for that pixels are batch compute together, then mixed. This is more memory efficient and allows vmap batching as far as possible.
• Shadowing within the same object / mesh is allowed. This is not possible in PyTinyrenderer, as it deliberately checks if the shadow comes from the same object; if so, it will not consider to draw a shadow there.
• Quaternion (for specifying rotation/orientation) is in the form of (w, x, y, z) instead of (x, y, z, w) in PyTinyrenderer. This is for consistency with BRAX.
• Fix bugs
  • Specular lighting was wrong, where it forgets to reverse the light direction vector.

Roadmap

• Correctly implement a proper clipping algorithm
• Support double-sided objects
• Profile and accelerate implementation
• Differentiable rendering
• Build a ray tracer as well