Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

curl_cffi

Python binding for curl-impersonate via cffi.

Documentation | 中文 README

Unlike other pure python http clients like httpx or requests, curl_cffi can impersonate browsers' TLS signatures or JA3 fingerprints. If you are blocked by some website for no obvious reason, you can give this package a try.

Features

  • Supports JA3/TLS and http2 fingerprints impersonation.
  • Much faster than requests/httpx/tls_client, on par with aiohttp/pycurl, see benchmarks.
  • Mimics requests API, no need to learn another one.
  • Pre-compiled, so you don't have to compile on your machine.
  • Supports asyncio with proxy rotation on each request.
  • Supports http 2.0, which requests does not.

Install

pip install curl_cffi --upgrade

This should work on Linux(x86_64/aarch64), macOS(Intel/Apple Silicon) and Windows(amd64). If it does not work on you platform, you may need to compile and install curl-impersonate first and set some environment variables like LD_LIBRARY_PATH.

To install beta releases:

pip install curl_cffi --pre

Usage

requests-like

from curl_cffi import requests

# Notice the impersonate parameter
r = requests.get("https://tls.browserleaks.com/json", impersonate="chrome110")

print(r.json())
# output: {..., "ja3n_hash": "aa56c057ad164ec4fdcb7a5a283be9fc", ...}
# the js3n fingerprint should be the same as target browser

# http/socks proxies are supported
proxies = {"https": "http://localhost:3128"}
r = requests.get("https://tls.browserleaks.com/json", impersonate="chrome110", proxies=proxies)

proxies = {"https": "socks://localhost:3128"}
r = requests.get("https://tls.browserleaks.com/json", impersonate="chrome110", proxies=proxies)

Sessions

# sessions are supported
s = requests.Session()
# httpbin is a http test website
s.get("https://httpbin.org/cookies/set/foo/bar")
print(s.cookies)
# <Cookies[<Cookie foo=bar for httpbin.org />]>
r = s.get("https://httpbin.org/cookies")
print(r.json())
# {'cookies': {'foo': 'bar'}}

Supported impersonate versions, as supported by curl-impersonate:

  • chrome99
  • chrome100
  • chrome101
  • chrome104
  • chrome107
  • chrome110
  • chrome99_android
  • edge99
  • edge101
  • safari15_3
  • safari15_5

asyncio

from curl_cffi.requests import AsyncSession

async with AsyncSession() as s:
    r = await s.get("https://example.com")

More concurrency:

import asyncio
from curl_cffi.requests import AsyncSession

urls = [
    "https://googel.com/",
    "https://facebook.com/",
    "https://twitter.com/",
]

async with AsyncSession() as s:
    tasks = []
    for url in urls:
        task = s.get("https://example.com")
        tasks.append(task)
    results = await asyncio.gather(*tasks)

curl-like

Alternatively, you can use the low-level curl-like API:

from curl_cffi import Curl, CurlOpt
from io import BytesIO

buffer = BytesIO()
c = Curl()
c.setopt(CurlOpt.URL, b'https://tls.browserleaks.com/json')
c.setopt(CurlOpt.WRITEDATA, buffer)

c.impersonate("chrome110")

c.perform()
c.close()
body = buffer.getvalue()
print(body.decode())

See the docs for more details.

Acknowledgement

  • Originally forked from multippt/python_curl_cffi, which is under the MIT license.
  • Headers/Cookies files are copied from httpx, which is under the BSD license.
  • Asyncio support is inspired by Tornado's curl http client.

Metadata

Release files for curl-cffi 0.5.9b4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for curl-cffi 0.5.9b4
File Size Uploaded Provenance Actions
curl_cffi-0.5.9b4.tar.gz 31.6 kB Without provenance Details for curl_cffi-0.5.9b4.tar.gz

Built distributions (wheels)

Table of built distributions (wheels) for curl-cffi 0.5.9b4
File Actions
curl_cffi-0.5.9b4-cp37-abi3-win_amd64.whl CPython 3.7 abi3 Windows x86-64 Details for curl_cffi-0.5.9b4-cp37-abi3-win_amd64.whl
curl_cffi-0.5.9b4-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl CPython 3.7 abi3 Linux glibc 2.17+ x86-64 Details for curl_cffi-0.5.9b4-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
curl_cffi-0.5.9b4-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl CPython 3.7 abi3 Linux glibc 2.17+ ARM64 Details for curl_cffi-0.5.9b4-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
curl_cffi-0.5.9b4-cp37-abi3-macosx_11_0_arm64.whl CPython 3.7 abi3 macOS 11.0+ ARM64 Details for curl_cffi-0.5.9b4-cp37-abi3-macosx_11_0_arm64.whl
curl_cffi-0.5.9b4-cp37-abi3-macosx_10_9_x86_64.whl CPython 3.7 abi3 macOS 10.9+ x86-64 Details for curl_cffi-0.5.9b4-cp37-abi3-macosx_10_9_x86_64.whl

Total release size: 23.8 MB

Release files / curl_cffi-0.5.9b4.tar.gz

Download URL curl_cffi-0.5.9b4.tar.gz
Size 31.6 kB
Tags Source
SHA-256 checksum
How to use checksums
63014af124877cf856209885fdd9857015f33a2d01a38986b55767fdc65b2260
BLAKE2b-256 checksum
How to use checksums
eaa6a48322cc9b6ed58e3f3c94f3fd38bf71a36ff3cb364b9ea6e4696b133c09
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / curl_cffi-0.5.9b4-cp37-abi3-win_amd64.whl

Download URL curl_cffi-0.5.9b4-cp37-abi3-win_amd64.whl
Size 2.6 MB
Tags CPython 3.7 Windows x86-64 abi3
SHA-256 checksum
How to use checksums
c5999830d2a4dd505a7b294a40475349166e49d7cc38affd616faaef730ac740
BLAKE2b-256 checksum
How to use checksums
124a3e540e16ad83f84d21b52884a63c52f7de04aa5d91765206751d7b014fb7
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / curl_cffi-0.5.9b4-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl

Download URL curl_cffi-0.5.9b4-cp37-abi3-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
Size 7.2 MB
Tags CPython 3.7 Linux glibc 2.17+ x86-64 abi3
SHA-256 checksum
How to use checksums
cc04b7a4db92b426eb45e1568126d07358d2788e8d99248a0dbd617f646ebdbb
BLAKE2b-256 checksum
How to use checksums
c39aa725286881ff16461a52b20f60364f725c9352a2dd11e1b39b331c439440
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / curl_cffi-0.5.9b4-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl

Download URL curl_cffi-0.5.9b4-cp37-abi3-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
Size 6.9 MB
Tags CPython 3.7 Linux glibc 2.17+ ARM64 abi3
SHA-256 checksum
How to use checksums
5e5d63c059eb74dd8e3a4447a7d563924f4a255ec8b2c2b3926b7ec264491062
BLAKE2b-256 checksum
How to use checksums
eabd7c3acd517db5417b9ed6f8dbbefed7cc08ef2bfc2be9c52dd1efb56e4286
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Release files / curl_cffi-0.5.9b4-cp37-abi3-macosx_11_0_arm64.whl

Download URL curl_cffi-0.5.9b4-cp37-abi3-macosx_11_0_arm64.whl
Size 2.2 MB
Tags CPython 3.7 abi3 macOS 11.0+ ARM64
SHA-256 checksum
How to use checksums
35091821562b761456f71c6218e89ba4dba345f78fb47524f08f3481a87e2c01
BLAKE2b-256 checksum
How to use checksums
ecccd549dbb2c5866f7f45c4ab3f9acdb785504b46df23ae99e4fd7a40b4759b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.8.16

Release files / curl_cffi-0.5.9b4-cp37-abi3-macosx_10_9_x86_64.whl

Download URL curl_cffi-0.5.9b4-cp37-abi3-macosx_10_9_x86_64.whl
Size 4.9 MB
Tags CPython 3.7 abi3 macOS 10.9+ x86-64
SHA-256 checksum
How to use checksums
ed631fb3d47c822ecca7ff55aa9e5b3a45beb70443c9f5f4e572d03eb46e8f11
BLAKE2b-256 checksum
How to use checksums
4e55f39b31d48892c434849655af8096d59217be69d5bc83802915c0cee1cfd3
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/4.0.2 CPython/3.9.18

Security for curl-cffi 0.5.9b4

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Release history Release notifications | RSS feed

This release
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page