portal 3.8.1

Fast and reliable distributed systems in Python

🌀 Portal

Fast and reliable distributed systems in Python.

Features

• 📡 Communication: Portal lets you bind functions to a Server and call them from one or more Clients. Wait on results via Future objects. Clients can automatically restore broken connections.
• 🚀 Performance: Optimized for throughput and latency. Array data is zero-copy serialized and deserialized for throughput near the hardware limit.
• 🤸 Flexibility: Function inputs and outputs can be nested dicts and lists of numbers, strings, bytes, None values, and Numpy arrays. Bytes allow applications to chose their own serialization, such as pickle.
• 🚨 Error handlings: Provides Process and Thread objects that can reliably be killed by the parent. Unhandled exceptions in threads stop the program. Error files can be used to stop distributed systems.
• 📦 Request batching: Use BatchServer to collect multiple incoming requests and process them at once, for example for AI inference servers. Batching and dispatching happens in a separate process to free the GIL.
• ✅ Correctness: Covered by over 100 unit tests for common usage and edge cases and used for large scale distributed AI systems.

Installation

pip install portal

Example

This example runs the server and client in the same Python program using subprocesses, but they could also be separate Python scripts running on different machines.

def server():
  import portal
  server = portal.Server(2222)
  server.bind('add', lambda x, y: x + y)
  server.bind('greet', lambda msg: print('Message from client:', msg))
  server.start()

def client():
  import portal
  client = portal.Client('localhost:2222')
  future = client.add(12, 42)
  result = future.result()
  print(result)  # 54
  client.greet('Hello World')

if __name__ == '__main__':
  import portal
  server_proc = portal.Process(server, start=True)
  client_proc = portal.Process(client, start=True)
  client_proc.join()
  server_proc.kill()
  print('Done')

Questions

Please open a separate GitHub issue for each question.