Skip to main content

Fast and reliable distributed systems in Python

Project description

PyPI

🌀 Portal

Fast and reliable distributed systems in Python.

Features

  • 📡 Communication: Portal lets you bind functions to a Server and call them from one or more Clients. Wait on results via Future objects. Clients can automatically restore broken connections.
  • 🚀 Performance: Optimized for throughput and latency. Array data is zero-copy serialized and deserialized for throughput near the hardware limit.
  • 🤸 Flexibility: Function inputs and outputs can be nested dicts and lists of numbers, strings, bytes, None values, and Numpy arrays. Bytes allow applications to chose their own serialization, such as pickle.
  • 🚨 Error handlings: Provides Process and Thread objects that can reliably be killed by the parent. Unhandled exceptions in threads stop the program. Error files can be used to stop distributed systems.
  • 📦 Request batching: Use BatchServer to collect multiple incoming requests and process them at once, for example for AI inference servers. Batching and dispatching happens in a separate process to free the GIL.
  • Correctness: Covered by over 100 unit tests for common usage and edge cases and used for large scale distributed AI systems.

Installation

pip install portal

Example

This example runs the server and client in the same Python program using subprocesses, but they could also be separate Python scripts running on different machines.

def server():
  import portal
  server = portal.Server(2222)
  server.bind('add', lambda x, y: x + y)
  server.bind('greet', lambda msg: print('Message from client:', msg))
  server.start()

def client():
  import portal
  client = portal.Client('localhost:2222')
  future = client.add(12, 42)
  result = future.result()
  print(result)  # 54
  client.greet('Hello World')

if __name__ == '__main__':
  import portal
  server_proc = portal.Process(server, start=True)
  client_proc = portal.Process(client, start=True)
  client_proc.join()
  server_proc.kill()
  print('Done')

Questions

Please open a separate GitHub issue for each question.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

portal-3.7.3.tar.gz (27.4 kB view details)

Uploaded Source

File details

Details for the file portal-3.7.3.tar.gz.

File metadata

  • Download URL: portal-3.7.3.tar.gz
  • Upload date:
  • Size: 27.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/6.1.0 CPython/3.12.9

File hashes

Hashes for portal-3.7.3.tar.gz
Algorithm Hash digest
SHA256 543b8e177d22b2efb3c3a966ab0164871ef6a31a5cf60faf2d45286b3efd969b
MD5 dc2a899a63d3384d40f1f9557779e312
BLAKE2b-256 f08d03dcd20105d0009751e2df903ab06b2141f4cd448e87911bab36429f8094

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page