GitHub  •  LinkedIn  •  X  •  Discord

Telekinesis Isaac Sim

Telekinesis Isaac Sim is a Python client for the Telekinesis Isaac Sim bridge, built on a C++ core.

Installation

It's highly recommended to install into a dedicated Conda environment:

conda create -n isaacsimclient python=3.12
conda activate isaacsimclient

Then install the package:

pip install telekinesis-isaacsim-client

Example Usage

from telekinesis.isaacsim_client import IsaacSimClient

client = IsaacSimClient(
    api_key="",
    base_url="http://127.0.0.1:8766",
    websocket_base_url="ws://127.0.0.1:8766",
)

created = client.articulation.create("/World/ur10e")
print(created["articulation_id"])

client.articulation.set_joint_positions(created["articulation_id"], [0.0] * created["num_dof"])

Suction grippers have their own group. close() blocks until the grip settles, so the status it returns is the settled one:

gripper = client.surface_gripper.create("/World/suction_gripper")
result = client.surface_gripper.close(gripper["surface_gripper_id"])
print(result["status"], result["gripped_objects"])

Cameras are registered the same way. capture() blocks until the frame is current, so the outputs it returns are that frame's own, and it activates any supported render output the camera isn't producing yet. Each output is a numpy array, because the bridge sends pixels as raw bytes rather than as JSON numbers:

camera = client.camera.create("/World/camera", resolution=[320, 240])
print(camera["active_data_types"], camera["supported_data_types"])

# depth isn't active on a new camera, so this first capture activates it.
frame = client.camera.capture(camera["camera_id"], ["rgb", "depth"])
print(frame["rgb"].shape, frame["depth"].dtype)

# A captured pointcloud is relative to the camera; ask for stage coordinates
# with world_frame=True.
frame = client.camera.capture(camera["camera_id"], ["pointcloud"])

More examples will soon be available on Telekinesis IsaacSim Examples

Resources

• Documentation: full API reference and guides.

Support

• Open an issue on GitHub.
• Email: support@telekinesis.ai
• Discord

License

Proprietary. © Telekinesis. All rights reserved.