Skip to main content

Asyncio interface for ROS 2, Zenoh, and other robotic middlewares.

Project description

Asyncio For Robotics

Requirements Compatibility Tests
python
mit
zenoh
ros
Python
ROS 2

The Asyncio For Robotics (afor) library makes asyncio usable with ROS 2, Zenoh and more, letting you write linear, testable, and non-blocking Python code.

  • Better syntax.
  • Only native python: Better docs and support.
  • No ROS 2 executor.
  • Simplifies testing.

Will this make my code slower? No.

Will this make my code faster? No. However asyncio will help YOU write better, faster code.

Does it replace ROS 2? Is this a wrapper? No. It is a tool adding async capabilities. It gives you more choices, not less.

Install

Barebone

pip install asyncio_for_robotics

For ROS 2

Compatible with: jazzy,humble and newer. This library is pure python (>=3.10), so it installs easily.

pip install asyncio_for_robotics

For Zenoh

pip install asyncio_for_robotics[zenoh]

Read more

Code sample

Syntax is identical between ROS 2 and Zenoh.

Wait for messages one by one

Application:

  • Get the latest sensor data
  • Get clock value
  • Wait for trigger
  • Wait for system to be operational
sub = afor.Sub(...)

# get the latest message
latest = await sub.wait_for_value()

# get a new message
new = await sub.wait_for_new()

# get the next message received
next = await sub.wait_for_next()

Continuously listen to a data stream

Application:

  • Process a whole data stream
  • React to changes in sensor data
# Continuously process the latest messages
async for msg in sub.listen():
    status = foo(msg)
    if status == DONE:
        break

# Continuously process all incoming messages
async for msg in sub.listen_reliable():
    status = foo(msg)
    if status == DONE:
        break

Reliable, non-drifting Rate

Application:

  • Periodic updates and actions
# Rate is simply a subscriber triggering on every tick
rate = afor.Rate(frequency=0.01, time_source=time.time_ns)

# Wait for the next tick
await rate.wait_for_new()

# Executes after a tick
async for _ in rate.listen():
    foo(...)

# Reliably executes for every tick
async for _ in sub.listen_reliable():
    foo(...)

Improved Services / Queryable for ROS 2

Services are needlessly convoluted in ROS 2 and intrinsically not async (because the server callback function MUST return a response). afor overrides the ROS behavior, allowing for the response to be sent later. Implementing similar systems for a transport protocol (that is not suffering from skill issues) should be very easy: The server is just a asyncio_for_robotics.core.BaseSub generating responder objects.

Application:

  • Client request reply from a server.
  • Servers can delay their response without blocking (not possible in ROS 2)
# Server is once again a afor subscriber, but generating responder objects
server = afor.Server(...)

# processes all requests.
# listen_reliable method is recommanded as it cannot skip requests
async for responder in server.listen_reliable():
    if responder.request == "PING!":
        reponder.response = "PONG!"
        await asyncio.sleep(...) # reply can be differed
        reponder.send()
    else:
        ... # reply not necessary
# the client implements a async call method
client = afor.Client(...)

response = await client.call("PING!")

Process for the right amount of time

Application:

  • Test if the system is responding as expected
  • Run small tasks with small and local code
# Listen with a timeout
data = await afor.soft_wait_for(sub.wait_for_new(), timeout=1)
if isinstance(data, TimeoutError):
    pytest.fail(f"Failed to get new data in under 1 second")


# Process a codeblock with a timeout
async with afor.soft_timeout(1):
    sum = 0
    total = 0
    async for msg in sub.listen_reliable():
        number = process(msg)
        sum += number
        total += 1

last_second_average = sum/total
assert last_second_average == pytest.approx(expected_average)

About Speed

The inevitable question: “But isn’t this slower than the ROS 2 executor? ROS 2 is the best!”

In short: rclpy's executor is the bottleneck.

  • Comparing to the best ROS 2 Jazzy can do (SingleThreadedExecutor), afor increases latency from 110us to 150us.
  • Comparing to other execution methods, afor is equivalent if not faster.
  • If you find it slow, you should use C++ or Zenoh (or contribute to this repo?).

Benchmark code is available in ./tests/bench/, it consists in two pairs of pub/sub infinitely echoing a message (using one single node). The messaging rate, thus measures the request to response latency.

With afor Transport Executor Frequency (kHz) Latency (ms)
✔️ Zenoh None 95 0.01
✔️ ROS 2 Experimental Asyncio 17 0.06
ROS 2 Experimental Asyncio 13 0.08
ROS 2 SingleThreaded 9 0.11
✔️ ROS 2 SingleThreaded 7 0.15
✔️ ROS 2 MultiThreaded 3 0.3
ROS 2 MultiThreaded 3 0.3
✔️ ROS 2 ros_loop Method 3 0.3

Details:

  • uvloop was used, replacing the asyncio executor (more or less doubles the performances for Zenoh)
  • RMW was set to rmw_zenoh_cpp
  • ROS2 benchmarks uses afor's ros2.ThreadedSession (the default in afor).
  • Only the Benchmark of the ros_loop method uses afor's second type of session: ros2.SynchronousSession.
  • ROS 2 executors can easily be changed in afor when creating a session.
  • The experimental AsyncioExecutor PR on ros rolling by nadavelkabets is incredible https://github.com/ros2/rclpy/pull/1399. Maybe I will add proper support for it (but only a few will want to use an unmerged experimental PR of ROS 2 rolling).
  • If there is interest in those benchmarks I will improve them, so others can run them all easily.

Analysis:

  • Zenoh is extremely fast, proving that afor is not the bottleneck.
  • This AsyncioExecutor having better perf when using afor is interesting, because afor does not bypass code.
    • I think this is due to AsyncioExecutor having some overhead that affects its own callback.
    • Without afor the ROS 2 callback executes some code and publishes.
    • With afor the ROS 2 callback returns immediately, and fully delegates execution to asyncio.
  • The increase of latency on the SingleThreaded executors proves that getting data in and out of the rclpy executor and thread is the main bottleneck.
    • AsyncioExecutor does not have such thread, thus can directly communicate.
    • Zenoh has its own thread, however it is built exclusively for multi-thread operations, without any executor. Thus achieves far superior performances.
  • MultiThreadedExecutor is just famously slow.
  • Very surprisingly, the well known ros_loop method detailed here https://github.com/m2-farzan/ros2-asyncio is slow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

asyncio_for_robotics-1.0.2a2.tar.gz (29.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

asyncio_for_robotics-1.0.2a2-py3-none-any.whl (32.1 kB view details)

Uploaded Python 3

File details

Details for the file asyncio_for_robotics-1.0.2a2.tar.gz.

File metadata

File hashes

Hashes for asyncio_for_robotics-1.0.2a2.tar.gz
Algorithm Hash digest
SHA256 51714c478c17fb38e17ff0317f9f4d14b87de3d4e2a816c81f91eca92a012a3e
MD5 6285b631f7f3c376b788267df41e0e55
BLAKE2b-256 4c9917171a88e8d0e95f890ac57a1327ca2b43a46c3870b07e6314bb71167318

See more details on using hashes here.

File details

Details for the file asyncio_for_robotics-1.0.2a2-py3-none-any.whl.

File metadata

File hashes

Hashes for asyncio_for_robotics-1.0.2a2-py3-none-any.whl
Algorithm Hash digest
SHA256 07ce575b848c9da7a33ccff09008ce5024fdf939a76c2fd3220284aa26f36f19
MD5 9cac499887e55dc4737b2b9c7d6a267a
BLAKE2b-256 2e59c994987bc726ee6d51c968ee682b95df174b896c2d44f739b099b4cef37b

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page