Skip to main content

A package to convert API responses to pandas dataframe

Project description

API to DataFrame

Python library that simplifies obtaining data from API endpoints by converting them directly into Pandas DataFrames. This library offers robust features, including retry strategies for failed requests.

Github

PyPI - Status PyPI - Downloads PyPI - Version

PyPI - Python Version

CI CD

Codecov

Project Stack

Python  Docker  Poetry  GitHub Actions  CodeCov  pypi  pandas  pytest 

Installation

To install the package using pip, use the following command:

pip install api-to-dataframe

To install the package using poetry, use the following command:

poetry add api-to-dataframe

User Guide

## Importing library
from api_to_dataframe import ClientBuilder, RetryStrategies

# Create a client for simple ingest data from API (timeout 1 second)
client = ClientBuilder(endpoint="https://api.example.com")

# if you can define timeout with LINEAR_RETRY_STRATEGY and set headers:
headers = {
    "application_name": "api_to_dataframe"
}
client = ClientBuilder(endpoint="https://api.example.com"
                        ,retry_strategy=RetryStrategies.LINEAR_RETRY_STRATEGY
                        ,connection_timeout=2
                        ,headers=headers)

# if you can define timeout with EXPONENTIAL_RETRY_STRATEGY and set headers:
client = ClientBuilder(endpoint="https://api.example.com"
                        ,retry_strategy=RetryStrategies.EXPONENTIAL_RETRY_STRATEGY
                        ,connection_timeout=10
                        ,headers=headers
                        ,retries=5
                        ,initial_delay=10)


# Get data from the API
data = client.get_api_data()

# Convert the data to a DataFrame
df = client.api_to_dataframe(data)

# Display the DataFrame
print(df)

Important notes:

  • Opcionals Parameters: The params timeout, retry_strategy and headers are opcionals.

  • Default Params Value: By default the quantity of retries is 3 and the time between retries is 1 second, but you can define manually.

  • Max Of Retries: For security of API Server there is a limit for quantity of retries, actually this value is 5, this value is defined in lib constant. You can inform any value in RETRIES param, but the lib only will try 5x.

  • Exponential Retry Strategy: The increment of time between retries is time passed in initial_delay param * 2 * the retry_number, e.g with initial_delay=2

    RetryNumber WaitingTime
    2 2s
    2 4s
    3 6s
    4 8s
    5 10s
  • Linear Retry Strategy: The increment of time between retries is time passed in initial_delay e.g with initial_delay=2

    RetryNumber WaitingTime
    1 2s
    2 2s
    3 2s
    4 2s
    5 2s

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

api_to_dataframe-1.3.10.tar.gz (5.5 kB view details)

Uploaded Source

Built Distribution

api_to_dataframe-1.3.10-py3-none-any.whl (7.3 kB view details)

Uploaded Python 3

File details

Details for the file api_to_dataframe-1.3.10.tar.gz.

File metadata

  • Download URL: api_to_dataframe-1.3.10.tar.gz
  • Upload date:
  • Size: 5.5 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.9.19 Linux/6.5.0-1025-azure

File hashes

Hashes for api_to_dataframe-1.3.10.tar.gz
Algorithm Hash digest
SHA256 aad61db01a36f86d779cd872beb3f10a6dedc0a0250db2ae379a9ed2cb5dc136
MD5 f188d5d0f47a0fda56bdcaaff2f80266
BLAKE2b-256 49e1c3ce4966a222338628cd0e391506e045be402cd4591544c0f495ea58d845

See more details on using hashes here.

File details

Details for the file api_to_dataframe-1.3.10-py3-none-any.whl.

File metadata

  • Download URL: api_to_dataframe-1.3.10-py3-none-any.whl
  • Upload date:
  • Size: 7.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.9.19 Linux/6.5.0-1025-azure

File hashes

Hashes for api_to_dataframe-1.3.10-py3-none-any.whl
Algorithm Hash digest
SHA256 fe8ab28b82270aaed4bbcd1fde22f4447e9be918e07f012f855c403dfce07cb3
MD5 8d103a6e41a757f97ad2b90c2fcf65e2
BLAKE2b-256 a908072142f03022dcc2c5d2e934592070f99851b611496b5855415e996439b2

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page