Skip to main content

An asyncio-focused library for webrtc robot control

Project description

RTCBot

PyPI npm Documentation Status Join the chat at https://gitter.im/rtcbot/community CircleCI

RTCBot's purpose is to provide a set of simple modules that help in developing remote-controlled robots in Python, with a focus on the Raspberry Pi.

The documentation includes tutorials that guide in developing your robot, starting from a basic connection between a Raspberry Pi and Browser, and encompass creating a video-streaming robot controlled entirely over a 4G mobile connection, all the way to a powerful system that offloads complex computation to a desktop PC in real-time.

All communication happens through WebRTC, using Python 3's asyncio and the wonderful aiortc library, meaning that your robot can be controlled with low latency both from the browser and through Python, even when it is not connected to your local network.

The library is explained piece by piece in the documentation.

See Documentation & Tutorials

Example

This example uses RTCBot to live stream a webcam to the browser. For details, please look at the tutorials.

Python code that streams video to the browser:

from aiohttp import web
routes = web.RouteTableDef()

from rtcbot import RTCConnection, getRTCBotJS, CVCamera

camera = CVCamera()
# For this example, we use just one global connection
conn = RTCConnection()
conn.video.putSubscription(camera)

# Serve the RTCBot javascript library at /rtcbot.js
@routes.get("/rtcbot.js")
async def rtcbotjs(request):
    return web.Response(content_type="application/javascript", text=getRTCBotJS())

# This sets up the connection
@routes.post("/connect")
async def connect(request):
    clientOffer = await request.json()
    serverResponse = await conn.getLocalDescription(clientOffer)
    return web.json_response(serverResponse)

@routes.get("/")
async def index(request):
    with open("index.html", "r") as f:
        return web.Response(content_type="text/html", text=f.read())

async def cleanup(app):
    await conn.close()
    camera.close()

app = web.Application()
app.add_routes(routes)
app.on_shutdown.append(cleanup)
web.run_app(app)

Browser code (index.html) that displays the video stream:

<html>
  <head>
    <title>RTCBot: Video</title>
    <script src="/rtcbot.js"></script>
  </head>
  <body style="text-align: center;padding-top: 30px;">
    <video autoplay playsinline></video> <audio autoplay></audio>
    <p>
      Open the browser's developer tools to see console messages (CTRL+SHIFT+C)
    </p>
    <script>
      var conn = new rtcbot.RTCConnection();

      conn.video.subscribe(function(stream) {
        document.querySelector("video").srcObject = stream;
      });

      async function connect() {
        let offer = await conn.getLocalDescription();

        // POST the information to /connect
        let response = await fetch("/connect", {
          method: "POST",
          cache: "no-cache",
          body: JSON.stringify(offer)
        });

        await conn.setRemoteDescription(await response.json());

        console.log("Ready!");
      }
      connect();
    </script>
  </body>
</html>

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

rtcbot-0.0.6.tar.gz (33.0 kB view details)

Uploaded Source

Built Distribution

rtcbot-0.0.6-py3-none-any.whl (40.5 kB view details)

Uploaded Python 3

File details

Details for the file rtcbot-0.0.6.tar.gz.

File metadata

  • Download URL: rtcbot-0.0.6.tar.gz
  • Upload date:
  • Size: 33.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2

File hashes

Hashes for rtcbot-0.0.6.tar.gz
Algorithm Hash digest
SHA256 773cc87899e909eba26eed6b4833f5dfc17d826388747454b179e442ab1a2e37
MD5 7f7f855e02c0bfdbabab0cc0e56d965c
BLAKE2b-256 9ea61cb69062c7a4f113f5c2cb8fb5ec77504f15b6d924ebe36be3a1db86496b

See more details on using hashes here.

File details

Details for the file rtcbot-0.0.6-py3-none-any.whl.

File metadata

  • Download URL: rtcbot-0.0.6-py3-none-any.whl
  • Upload date:
  • Size: 40.5 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.13.0 pkginfo/1.5.0.1 requests/2.21.0 setuptools/40.8.0 requests-toolbelt/0.9.1 tqdm/4.31.1 CPython/3.7.2

File hashes

Hashes for rtcbot-0.0.6-py3-none-any.whl
Algorithm Hash digest
SHA256 1cf097375cac180c575577d7a9c0d9f3c283f99b27054629d47728dc93b14eb5
MD5 c843def762fff1a106b7d3d7c2cb3f44
BLAKE2b-256 19af34fbbb5dfc771cd4f225ff955e8c07f047a6be7495e91190e12bd043fe07

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page