Skip to main content

Asyncio interface for ROS 2, Zenoh, and other robotic middlewares.

Project description

Asyncio For Robotics

Requirements Compatibility Tests
python
mit
zenoh
ros
Python
ROS 2

The Asyncio For Robotics (afor) library makes asyncio usable with ROS 2, Zenoh and more, letting you write linear, testable, and non-blocking Python code.

  • Better syntax.
  • Only native python: Better docs and support.
  • No ROS 2 executor.
  • Simplifies testing.

Will this make my code slower? No.

Will this make my code faster? No. However asyncio will help YOU write better, faster code.

Does it replace ROS 2? Is this a wrapper? No. It is a tool adding async capabilities. It gives you more choices, not less.

Install

Barebone

pip install asyncio_for_robotics

For ROS 2

Compatible with: jazzy,humble and newer. This library is pure python (>=3.10), so it installs easily.

pip install asyncio_for_robotics

For Zenoh

pip install asyncio_for_robotics[zenoh]

Read more

Code sample

Syntax is identical between ROS 2 and Zenoh.

Wait for messages one by one

Application:

  • Get the latest sensor data
  • Get clock value
  • Wait for trigger
  • Wait for system to be operational
sub = afor.Sub(...)

# get the latest message
latest = await sub.wait_for_value()

# get a new message
new = await sub.wait_for_new()

# get the next message received
next = await sub.wait_for_next()

Continuously listen to a data stream

Application:

  • Process a whole data stream
  • React to changes in sensor data
# Continuously process the latest messages
async for msg in sub.listen():
    status = foo(msg)
    if status == DONE:
        break

# Continuously process all incoming messages
async for msg in sub.listen_reliable():
    status = foo(msg)
    if status == DONE:
        break

Reliable, non-drifting Rate

Application:

  • Periodic updates and actions
# Rate is simply a subscriber triggering on every tick
rate = afor.Rate(frequency=0.01, time_source=time.time_ns)

# Wait for the next tick
await rate.wait_for_new()

# Executes after a tick
async for _ in rate.listen():
    foo(...)

# Reliably executes for every tick
async for _ in sub.listen_reliable():
    foo(...)

Improved Services / Queryable for ROS 2

Services are needlessly convoluted in ROS 2 and intrinsically not async (because the server callback function MUST return a response). afor overrides the ROS behavior, allowing for the response to be sent later. Implementing similar systems for a transport protocol (that is not suffering from skill issues) should be very easy: The server is just a asyncio_for_robotics.core.BaseSub generating responder objects.

Application:

  • Client request reply from a server.
  • Servers can delay their response without blocking (not possible in ROS 2)
# Server is once again a afor subscriber, but generating responder objects
server = afor.Server(...)

# processes all requests.
# listen_reliable method is recommanded as it cannot skip requests
async for responder in server.listen_reliable():
    if responder.request == "PING!":
        reponder.response = "PONG!"
        await asyncio.sleep(...) # reply can be differed
        reponder.send()
    else:
        ... # reply not necessary
# the client implements a async call method
client = afor.Client(...)

response = await client.call("PING!")

Process for the right amount of time

Application:

  • Test if the system is responding as expected
  • Run small tasks with small and local code
# Listen with a timeout
data = await afor.soft_wait_for(sub.wait_for_new(), timeout=1)
if isinstance(data, TimeoutError):
    pytest.fail(f"Failed to get new data in under 1 second")


# Process a codeblock with a timeout
async with afor.soft_timeout(1):
    sum = 0
    total = 0
    async for msg in sub.listen_reliable():
        number = process(msg)
        sum += number
        total += 1

last_second_average = sum/total
assert last_second_average == pytest.approx(expected_average)

About Speed

The inevitable question: “But isn’t this slower than the ROS 2 executor? ROS 2 is the best!”

In short: rclpy's executor is the bottleneck.

  • Comparing to the best ROS 2 Jazzy can do (SingleThreadedExecutor), afor increases latency from 110us to 150us.
  • Comparing to other execution methods, afor is equivalent if not faster.
  • If you find it slow, you should use C++ or Zenoh (or contribute to this repo?).

Benchmark code is available in ./tests/bench/, it consists in two pairs of pub/sub infinitely echoing a message (using one single node). The messaging rate, thus measures the request to response latency.

With afor Transport Executor Frequency (kHz) Latency (ms)
✔️ Zenoh None 95 0.01
✔️ ROS 2 Experimental Asyncio 17 0.06
ROS 2 Experimental Asyncio 13 0.08
ROS 2 SingleThreaded 9 0.11
✔️ ROS 2 SingleThreaded 7 0.15
✔️ ROS 2 MultiThreaded 3 0.3
ROS 2 MultiThreaded 3 0.3
✔️ ROS 2 ros_loop Method 3 0.3

Details:

  • uvloop was used, replacing the asyncio executor (more or less doubles the performances for Zenoh)
  • RMW was set to rmw_zenoh_cpp
  • ROS2 benchmarks uses afor's ros2.ThreadedSession (the default in afor).
  • Only the Benchmark of the ros_loop method uses afor's second type of session: ros2.SynchronousSession.
  • ROS 2 executors can easily be changed in afor when creating a session.
  • The experimental AsyncioExecutor PR on ros rolling by nadavelkabets is incredible https://github.com/ros2/rclpy/pull/1399. Maybe I will add proper support for it (but only a few will want to use an unmerged experimental PR of ROS 2 rolling).
  • If there is interest in those benchmarks I will improve them, so others can run them all easily.

Analysis:

  • Zenoh is extremely fast, proving that afor is not the bottleneck.
  • This AsyncioExecutor having better perf when using afor is interesting, because afor does not bypass code.
    • I think this is due to AsyncioExecutor having some overhead that affects its own callback.
    • Without afor the ROS 2 callback executes some code and publishes.
    • With afor the ROS 2 callback returns immediately, and fully delegates execution to asyncio.
  • The increase of latency on the SingleThreaded executors proves that getting data in and out of the rclpy executor and thread is the main bottleneck.
    • AsyncioExecutor does not have such thread, thus can directly communicate.
    • Zenoh has its own thread, however it is built exclusively for multi-thread operations, without any executor. Thus achieves far superior performances.
  • MultiThreadedExecutor is just famously slow.
  • Very surprisingly, the well known ros_loop method detailed here https://github.com/m2-farzan/ros2-asyncio is slow.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

asyncio_for_robotics-1.0.2.tar.gz (29.7 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

asyncio_for_robotics-1.0.2-py3-none-any.whl (32.1 kB view details)

Uploaded Python 3

File details

Details for the file asyncio_for_robotics-1.0.2.tar.gz.

File metadata

File hashes

Hashes for asyncio_for_robotics-1.0.2.tar.gz
Algorithm Hash digest
SHA256 24e6b04c1d4712f4565c430ee2b9b775b0fc73aa23c8787f793b7569480b3662
MD5 84e75e9af7d318ef0da7fbb3f8b286b2
BLAKE2b-256 63c26121e691802b2c6962c15ceced6f754cb734b89dd4be50683259d86fca63

See more details on using hashes here.

File details

Details for the file asyncio_for_robotics-1.0.2-py3-none-any.whl.

File metadata

File hashes

Hashes for asyncio_for_robotics-1.0.2-py3-none-any.whl
Algorithm Hash digest
SHA256 9a3e37993504434e954cfbabd74bf320abb3c82dd9a2d3d1596c207dd327cb68
MD5 a3b5a9d2d07b3485b70afdb94815b4cd
BLAKE2b-256 dcbd95e107c9c0ab9f825061e78d01745a9ece88061028a1886ae19e8268f073

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page