Skip to main content

Asyncio interface for ROS 2, Zenoh, and other robotic middlewares.

Project description

Asyncio For Robotics

Requirements Compatibility Tests
python
mit
zenoh
ros
Python
ROS 2

The Asyncio For Robotics (afor) library makes asyncio usable with ROS 2, Zenoh and more, letting you write linear, testable, and non-blocking Python code.

  • Better syntax.
  • Only native python: Better docs and support.
  • Simplifies testing.

Will this make my code slower? No.

Will this make my code faster? No. However asyncio will help YOU write better, faster code.

Does it replace ROS 2? Is this a wrapper? No. It is a tool adding async capabilities. It gives you more choices, not less.

Install

Barebone

pip install asyncio_for_robotics

For ROS 2

Compatible with: jazzy,humble and newer. This library is pure python (>=3.10), so it installs easily.

pip install asyncio_for_robotics

For Zenoh

pip install asyncio_for_robotics[zenoh]

Read more

Code sample

Syntax is identical between ROS 2 and Zenoh.

Wait for messages one by one

Application:

  • Get the latest sensor data
  • Get clock value
  • Wait for trigger
  • Wait for system to be operational
sub = afor.Sub(...)

# get the latest message
latest = await sub.wait_for_value()

# get a new message
new = await sub.wait_for_new()

# get the next message received
next = await sub.wait_for_next()

Continuously listen to a data stream

Application:

  • Process a whole data stream
  • React to changes in sensor data
# Continuously process the latest messages
async for msg in sub.listen():
    status = foo(msg)
    if status == DONE:
        break

# Continuously process all incoming messages
async for msg in sub.listen_reliable():
    status = foo(msg)
    if status == DONE:
        break

Reliable, non-drifting Rate

Application:

  • Periodic updates and actions
# Rate is simply a subscriber triggering on every tick
rate = afor.Rate(frequency=0.01, time_source=time.time_ns)

# Wait for the next tick
await rate.wait_for_new()

# Executes after a tick
async for _ in rate.listen():
    foo(...)

# Reliably executes for every tick
async for _ in sub.listen_reliable():
    foo(...)

Improved Services / Queryable for ROS 2

Services are needlessly convoluted in ROS 2 and intrinsically not async (because the server callback function MUST return a response). afor overrides the ROS behavior, allowing for the response to be sent later. Implementing similar systems for other transport protocol should be very easy: The server is just a asyncio_for_robotics.core.BaseSub generating responder objects.

Application:

  • Client request reply from a server.
  • Servers can delay their response without blocking (not possible in ROS 2)
# Server is once again a afor subscriber, but generating responder objects
server = afor.Server(...)

# processes all requests.
# listen_reliable method is recommanded as it cannot skip requests
async for responder in server.listen_reliable():
    if responder.request == "PING!":
        reponder.response = "PONG!"
        await asyncio.sleep(...) # reply can be differed
        reponder.send()
    else:
        ... # reply is not necessary
# the client implements a async call method
client = afor.Client(...)

response = await client.call("PING!")

Process for the right amount of time

Application:

  • Test if the system is responding as expected
  • Run small tasks with small and local code
# Listen with a timeout
data = await afor.soft_wait_for(sub.wait_for_new(), timeout=1)
if isinstance(data, TimeoutError):
    pytest.fail(f"Failed to get new data in under 1 second")


# Process a codeblock with a timeout
async with afor.soft_timeout(1):
    sum = 0
    total = 0
    async for msg in sub.listen_reliable():
        number = process(msg)
        sum += number
        total += 1

last_second_average = sum/total
assert last_second_average == pytest.approx(expected_average)

About Speed

The inevitable question: “But isn’t this slower than the ROS 2 executor? ROS 2 is the best!”

In short: rclpy's executor is the bottleneck.

  • Comparing to the best ROS 2 Jazzy can do (SingleThreadedExecutor), afor increases latency from 110us to 150us.
  • Comparing to other execution methods, afor is equivalent if not faster.
  • If you find it slow, you should use C++ or Zenoh (or contribute to this repo?).

Benchmark code is available in ./tests/bench/, it consists in two pairs of pub/sub infinitely echoing a message (using one single node). The messaging rate, thus measures the request to response latency.

With afor Transport Executor Frequency (kHz) Latency (ms)
✔️ Zenoh None 95 0.01
✔️ ROS 2 Experimental Asyncio 17 0.06
ROS 2 Experimental Asyncio 13 0.08
ROS 2 SingleThreaded 9 0.11
✔️ ROS 2 SingleThreaded 7 0.15
✔️ ROS 2 MultiThreaded 3 0.3
ROS 2 MultiThreaded 3 0.3
✔️ ROS 2 ros_loop Method 3 0.3

Details:

  • uvloop was used, replacing the asyncio executor (more or less doubles the performances for Zenoh)
  • RMW was set to rmw_zenoh_cpp
  • ROS2 benchmarks uses afor's ros2.ThreadedSession (the default in afor).
  • Only the Benchmark of the ros_loop method uses afor's second type of session: ros2.SynchronousSession.
  • ROS 2 executors can easily be changed in afor when creating a session.
  • The experimental AsyncioExecutor PR on ros rolling by nadavelkabets is incredible https://github.com/ros2/rclpy/pull/1399. Maybe I will add proper support for it (but only a few will want to use an unmerged experimental PR of ROS 2 rolling).
  • If there is interest in those benchmarks I will improve them, so others can run them all easily.

Analysis:

  • Zenoh is extremely fast, proving that afor is not the bottleneck.
  • This AsyncioExecutor having better perf when using afor is interesting, because afor does not bypass code.
    • I think this is due to AsyncioExecutor having some overhead that affects its own callback.
    • Without afor the ROS 2 callback executes some code and publishes.
    • With afor the ROS 2 callback returns immediately, and fully delegates execution to asyncio.
  • The increase of latency on the SingleThreaded executors proves that getting data in and out of the rclpy executor and thread is the main bottleneck.
    • AsyncioExecutor does not have such thread, thus can directly communicate.
    • Zenoh has its own thread, however it is built exclusively for multi-thread operations, without any executor. Thus achieves far superior performances.
  • MultiThreadedExecutor is just famously slow.
  • Very surprisingly, the well known ros_loop method detailed here https://github.com/m2-farzan/ros2-asyncio is slow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

asyncio_for_robotics-1.0.4.tar.gz (30.3 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

asyncio_for_robotics-1.0.4-py3-none-any.whl (34.2 kB view details)

Uploaded Python 3

File details

Details for the file asyncio_for_robotics-1.0.4.tar.gz.

File metadata

File hashes

Hashes for asyncio_for_robotics-1.0.4.tar.gz
Algorithm Hash digest
SHA256 48d9921c3c14ded892818718667ee86f50c2c7c8943007dfbf430745056bb1b3
MD5 983b471da8acc9a705a9dd08da7a816f
BLAKE2b-256 4cd06836bfd99128a50afb8cc73061922c714447453e419c3a4cf0103868b664

See more details on using hashes here.

File details

Details for the file asyncio_for_robotics-1.0.4-py3-none-any.whl.

File metadata

File hashes

Hashes for asyncio_for_robotics-1.0.4-py3-none-any.whl
Algorithm Hash digest
SHA256 c176db073cb837aab170349f8e0b470c84eb795338b7f2395b4e25fbc350995e
MD5 5a2ea8e7b86ffaa2a7b2d9a1d4cb7075
BLAKE2b-256 1361c841d047206b848fc594a1b9c681d52a37a3889a9f63a29951ebc58f7544

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page