A Python package to send data using Prometheus remote write protocol.
Project description
Prometheus Remote Writer
Introduction
prometheus-remote-writer is a Python library designed to simplify the process of writing data to a database using
the Prometheus Remote Write
protocol. This library is platform-independent and aims to provide developers with an intuitive way to send time-series
data to Prometheus-compatible storage.
Key Features
- Easily write data to Prometheus-compatible storage backends.
- Supports custom HTTP headers and authentication methods.
- Provides a simple and easy-to-use API.
- Supports batch data sending to improve transmission efficiency.
Installation
Before using prometheus-remote-writer, ensure that Python 3.8 or higher is installed on your system.
pip install prometheus-remote-writer
Quick Start
Here's a simple example of how to use prometheus-remote-writer in your project:
from prometheus_remote_writer import RemoteWriter
# Create a RemoteWriter instance
writer = RemoteWriter(
url='https://your-prometheus-server/api/v1/write',
headers={'Authorization': 'Bearer YOUR_ACCESS_TOKEN'}
)
# Prepare the data to send
data = [
{
'metric': {'__name__': 'cpu_usage', 'host': 'server1'},
'values': [23.5, 24.1, 22.8],
'timestamps': [1609459200000, 1609459260000, 1609459320000]
}
]
# Send the data
writer.send(data)
Configuration
RemoteWriter supports the following configuration parameters:
url(required): The URL of the Prometheus remote write endpoint.headers(optional): Custom HTTP headers for authentication or other purposes.timeout(optional): Request timeout in seconds, default is 10 seconds.auth(optional): Authentication credentials. Supports:- Basic auth:
{'username': 'user', 'password': 'pass'} - Bearer token:
{'bearer_token': 'your-token'}
- Basic auth:
verify(optional): SSL certificate verification. Options:True(default): Verify SSL certificatesFalse: Disable SSL certificate verification (useful for self-signed certificates)'/path/to/ca-bundle.crt': Path to a custom CA certificate bundle
proxies(optional): Proxy configuration as a dictionary, e.g.,{'http': 'http://proxy.com', 'https': 'https://proxy.com'}retries(optional): Number of retry attempts for failed requests, default is 3.max_series_per_request(optional): Maximum number of time series per request, default is 2000.auto_convert_seconds_to_ms(optional): Automatically convert timestamps from seconds to milliseconds, default is True.
Advanced Examples
Using Self-Signed Certificates
If your Prometheus server uses a self-signed certificate, you can disable SSL verification:
from prometheus_remote_writer import RemoteWriter
writer = RemoteWriter(
url='https://mimir.example.com/api/v1/push',
headers={'X-Scope-OrgID': 'test-id'},
verify=False # Disable SSL verification
)
Using Custom CA Certificate
Alternatively, you can provide a path to your custom CA certificate:
writer = RemoteWriter(
url='https://mimir.example.com/api/v1/push',
headers={'X-Scope-OrgID': 'test-id'},
verify='/path/to/ca-bundle.crt' # Custom CA certificate
)
Using Authentication
# Bearer token authentication
writer = RemoteWriter(
url='https://your-prometheus-server/api/v1/write',
auth={'bearer_token': 'YOUR_ACCESS_TOKEN'}
)
# Basic authentication
writer = RemoteWriter(
url='https://your-prometheus-server/api/v1/write',
auth={'username': 'user', 'password': 'pass'}
)
Using Proxy
writer = RemoteWriter(
url='https://your-prometheus-server/api/v1/write',
proxies={'http': 'http://proxy.example.com:8080', 'https': 'https://proxy.example.com:8080'}
)
Unit Testing
This project uses pytest for unit testing. To run the tests, execute the following command:
pytest
Contribution Guide
We welcome contributions from the community! To contribute to prometheus-remote-writer, please follow these steps:
Fork the repository.
Create your feature branch (git checkout -b feature/YourFeature).
Commit your changes (git commit -m 'Add some feature').
Push to the branch (git push origin feature/YourFeature).
Open a pull request.
FAQ
Why can't I connect to the Prometheus server?
Ensure your network connection is active and the url is correct. You may also need to configure firewall rules to
allow traffic.
How do I report a bug?
Please file a bug report on the GitHub issues page with detailed information and steps to reproduce the issue.
License
This project is licensed under the Apache License 2.0. See the LICENSE file for details.
Contact
If you have any questions or suggestions, feel free to contact us at xy.kong@gmail.com.
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file prometheus_remote_writer-1.1.3.tar.gz.
File metadata
- Download URL: prometheus_remote_writer-1.1.3.tar.gz
- Upload date:
- Size: 16.6 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/2.1.4 CPython/3.13.1 Darwin/25.2.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
168192a134094450cde01fc24e814808ed49eb7e3346b6b811797709c7efb824
|
|
| MD5 |
913d08c12f71b4406d3f374f8b4904bb
|
|
| BLAKE2b-256 |
184650041473ee7f24982ca3ed989952a2ef6ffe127fc033460c99a6c43cb6bf
|
File details
Details for the file prometheus_remote_writer-1.1.3-py3-none-any.whl.
File metadata
- Download URL: prometheus_remote_writer-1.1.3-py3-none-any.whl
- Upload date:
- Size: 17.6 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: poetry/2.1.4 CPython/3.13.1 Darwin/25.2.0
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
96a86b7d6cec955c311f70c131b0669d036e718695f57cc1a27a8cd3b34332a5
|
|
| MD5 |
e340518e6f4af262712e76537f8d7ba7
|
|
| BLAKE2b-256 |
cd75e304bbd2ce019060647d16185a33c25cc05b00f3500afd00f20b78136863
|