telekinesis-medulla 0.1.5

Module for connecting to cameras and hardware devices within the Telekinesis ecosystem.

Telekinesis Examples | Telekinesis Data

GitHub  •  LinkedIn  •  X  •  Discord

Medulla: Hardware Communication Skills

Medulla is a module in the Telekinesis SDK for connecting to cameras and hardware devices. It provides tools to interface with various 2D and 3D cameras and integrate them into Telekinesis applications. It includes:

• 2D and 3D camera interfacing
• Data acquisition and preprocessing
• Time-synchronized sensor streams
• Integration with Telekinesis modules (Vitreous, Retina, Cornea, Pupil, Neuroplan)

This library is used for robotics applications that require camera connectivity, including vision pipelines, multi-camera robot perception, and Physical AI agent integration.

Medulla is currently in its early development phase (pre-1.0). There will be continuous minor version updates that may introduce new features and improvements. To ensure compatibility and have the latest features, please always install or upgrade to the latest version of the package.

Installation

1. Create an isolated environment to avoid dependency conflicts. We recommend installing Miniconda by following the instructions from here.

2. Create a new conda environment called telekinesis-medulla:

   conda create -n telekinesis-medulla python=3.11
   

3. Activate the environment:

   conda activate telekinesis-medulla
   

4. Install the package using pip:

   We currently support Python versions - 3.11, 3.12. Ensure your environment is in the specified Python version.

   pip install telekinesis-medulla
   

Additional Setup

Camera drivers and vendor SDKs require additional installation steps. Please follow the Installation details for vendor-specific SDK setup.

Dependencies

Medulla requires BabyROS. Please refer to the README in BabyROS to install it.

Example

Install the optional dependencies in order to run the examples

Install the optional dependencies in order to run the examples

Run a sample Python script to quickly test your installation.

1. Create a Python file named medulla_example.py in a directory of your choice and paste the following:

   from telekinesis.medulla.cameras import webcam
   
   camera = webcam.Webcam(name="my_webcam", camera_id=0)
   camera.connect()
   image = camera.capture_single_color_frame()
   print(image)
   camera.disconnect()
   

2. On a terminal, navigate to the directory where medulla_example.py was created and run:

   python medulla_example.py
   

   Expected output: Some logs and an image from the connected webcam in the below format:

    ...
    [[[158 155 140]
    [159 155 142]
    [160 154 144]
    ...
    [255 255 252]
    [255 255 251]
    [255 255 251]]
    ...
   

Supported Cameras

Vendor	Status
Webcam	Available
IDS	Available
ZIVID	Coming Soon
SensoPart	Coming Soon
MechMind	Coming Soon
Azure Kinect	Coming Soon
Intel RealSense	Coming Soon

Resources

• Examples Runnable usage examples for Medulla: Telekinesis Examples

• Documentation Full SDK documentation and usage details: Telekinesis Documentation

• Sample Data Datasets used across the examples: Telekinesis Data

Support

For issues and questions:

• Create an issue in the GitHub repository.
• Contact the Telekinesis development team at [e-mail] or on Discord.

Resources

• Examples Runnable usage examples for Medulla: Telekinesis Examples

• Documentation Full SDK documentation and usage details: Telekinesis Documentation

• Sample Data Datasets used across the examples: Telekinesis Data

Support

For issues and questions:

• Create an issue in the GitHub repository.
• Contact the Telekinesis development team at [e-mail] or on Discord.