Skip to main content

A high performance FastAPI-based message consumer framework for PubSub

Project description

FastPubSub

A high performance FastAPI-based message consumer framework for Google PubSub


Documentation: https://github.com/matheusvnm/fastpubsub/wiki

Source Code: https://github.com/matheusvnm/fastpubsub


Features

FastPubSub is a modern, high-performance framework for building modern applications that process event messages on Google PubSub. It combines the standard PubSub Python SDK with FastAPI, Pydantic and Uvicorn to provide an easy-to-use development experience.

The key features are:

  • Fast: FastPubSub is (unironically) fast. It's built on top of FastAPI, uvicorn and Google PubSub Python SDK for maximum performance.
  • Intuitive: It is designed to be intuitive and easy to use, even for beginners.
  • Typed: Provides a great editor support and less time reading docs.
  • Robust: Get production-ready code with sensible default values helping you avoid common pitfalls.
  • Asynchronous: It is built on top of asyncio, which allows it to run on fully asynchronous code.
  • Batteries Included: Provides its own CLI and other widely used tools such as pydantic for data validation and log contextualization.

Quick Start

Installation

FastPubSub works on Linux, macOS, Windows and most Unix-style operating systems. You can install it with pip as usual:

pip install fastpubsub

Writing your first application

FastPubSub brokers provide convenient function decorators (@broker.subscriber) and methods (broker.publisher) to allow you to delegate the actual process of:

  • Creating Pub/Sub subscriptions to receive and process data from topics.
  • Publishing data to other topics downstream in your message processing pipeline.

These decorators make it easy to specify the processing logic for your consumers and producers, allowing you to focus on the core business logic of your application without worrying about the underlying integration.

Also, Pydantic’s BaseModel class allows you to define messages using a declarative syntax for sending messages downstream, making it easy to specify the fields and types of your messages.

Here is an example Python app using FastPubSub that consumes data from an incoming data stream and outputs two messages to another one:

# basic.py

from pydantic import BaseModel, Field
from fastpubsub import FastPubSub, PubSubBroker, Message
from fastpubsub.logger import logger

class Address(BaseModel):
    street: str = Field(..., examples=["5th Avenue"])
    number: str = Field(..., examples=["1548"])


broker = PubSubBroker(project_id="some-project-id")
app = FastPubSub(broker)

@broker.subscriber(
    alias="my_handler",
    topic_name="in_topic",
    subscription_name="sub_name",
)
async def handle_message(message: Message):
   logger.info(f"The message {message.id} is processed.")
   await broker.publish(topic_name="out_topic", data="Hi!")

   address = Address(street="Av. Flores", number="213")
   await broker.publish(topic_name="out_topic", data=address)

Running the application

Before running the command make sure to set one of the variables (mutually exclusive):

  1. Running PubSub on Cloud: The environment variable GOOGLE_APPLICATION_CREDENTIALS with the path of the service-account on your system.
  2. Running PubSub Emulator: The environment variable PUBSUB_EMULATOR_HOST with host:port of your local PubSub emulator.

After that, the application can be started using built-in FastPubSub CLI which is a core part of the framework.

To run the service, use the FastPubSub embedded CLI. Just execute the command run and pass the module (in this case, the file where the app implementation is located) and the app symbol to the command.

fastpubsub run basic:app

After running the command, you should see the following output:

2025-10-13 15:23:59,550 | INFO     | 97527:133552019097408 | runner:run:55 | FastPubSub app starting...
2025-10-13 15:23:59,696 | INFO     | 97527:133552019097408 | tasks:start:74 | The handle_message handler is waiting for messages.

Also, FastPubSub provides you with a great hot reload feature to improve your development experience

fastpubsub run basic:app --reload

And multiprocessing horizontal scaling feature as well:

fastpubsub run basic:app --workers 3

You can learn more about CLI's features here.

Contact

Feel free to get in touch by:

Sending a email at sandro-matheus@hotmail.com.

Sending a message on my linkedin.

License

This project is licensed under the terms of the Apache 2.0 license.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

fastpubsub-0.6.0.tar.gz (28.0 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

fastpubsub-0.6.0-py3-none-any.whl (39.8 kB view details)

Uploaded Python 3

File details

Details for the file fastpubsub-0.6.0.tar.gz.

File metadata

  • Download URL: fastpubsub-0.6.0.tar.gz
  • Upload date:
  • Size: 28.0 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.9.15 {"installer":{"name":"uv","version":"0.9.15","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fastpubsub-0.6.0.tar.gz
Algorithm Hash digest
SHA256 07301fe42e9900af4fd8cfa2c17fc75cc2fca9b244495c3c7900eb411428b8ab
MD5 1ffba816d76eab5bf7a3b72a7e8214bf
BLAKE2b-256 fe45ccd3e6f6cd2c4fa2e315c61bffb81d1dfbdca5d519e8959dac1ade4fc927

See more details on using hashes here.

File details

Details for the file fastpubsub-0.6.0-py3-none-any.whl.

File metadata

  • Download URL: fastpubsub-0.6.0-py3-none-any.whl
  • Upload date:
  • Size: 39.8 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? Yes
  • Uploaded via: uv/0.9.15 {"installer":{"name":"uv","version":"0.9.15","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"Ubuntu","version":"24.04","id":"noble","libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":true}

File hashes

Hashes for fastpubsub-0.6.0-py3-none-any.whl
Algorithm Hash digest
SHA256 edd9580da6570b52e0d56605ae4f6f4a7b9e173d48fedd29f9c80a493a241175
MD5 88f1399aba9a56262a9917f1f3d503a0
BLAKE2b-256 abf42edb5346a8aeb2d3715e47cb895df31d168d6b10a7913dd025ede97ca3a2

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page