A user-friendly wrapper for pycurl that simplifies HTTP requests
Project description
Request Curl
A user-friendly wrapper for pycurl that simplifies HTTP requests.
Installation
Use the package manager pip to install request_curl.
NOTE: You need Python and libcurl installed on your system to use or build pycurl. Some RPM distributions of curl/libcurl do not include everything necessary to build pycurl, in which case you need to install the developer specific RPM which is usually called curl-dev.
pip install request_curl
Quickstart
A request_curl session manages cookies, connection pooling, and configurations.
Basic Usage:
import request_curl
s = request_curl.Session()
s.get('https://httpbin.org/get') # returns <Response [200]>
s.request('GET', 'https://httpbin.org/get') # returns <Response [200]>
Using a Context Manager
import request_curl
with request_curl.Session() as session:
session.get('https://httpbin.org/get') # returns <Response [200]>
Features
Response Object
The response object is similar to that of the requests library.
import request_curl
s = request_curl.Session()
r = s.get("https://httpbin.org/get")
print(r) # prints response object
print(r.status_code) # prints status code
print(r.content) # prints response content in bytes
print(r.text) # prints response content as text
print(r.json) # prints response content as JSON
print(r.url) # prints response URL
print(r.headers) # prints response headers
Proxy Support
Format the proxy as a string.
import request_curl
s = request_curl.Session()
# supports authentication: r = s.get("https://httpbin.org/get", proxies="ip:port:user:password")
r = s.get("https://httpbin.org/get", proxies="ip:port")
HTTP2
HTTP2 is disabled by default.
import request_curl
s = request_curl.Session(http2=True)
r = s.get("https://httpbin.org/get")
Cipher Suites
You can specify custom cipher suites as an array.
import request_curl
cipher_suite = [
"AES128-SHA256",
"AES256-SHA256",
"AES128-GCM-SHA256",
"AES256-GCM-SHA384"
]
s = request_curl.Session(cipher_suite=cipher_suite)
r = s.get("https://httpbin.org/get")
Debug Request
Set debug to True to print raw input and output headers.
import request_curl
s = request_curl.Session()
r = s.get("https://httpbin.org/get", debug=True)
Custom Headers
Specify custom headers as a dictionary.
import request_curl
s = request_curl.Session()
headers = {
"User-Agent": "Mozilla/5.0 (Windows NT 10.0; Win64; x64) AppleWebKit/537.36 (KHTML, like Gecko) Chrome/80.0.3987.163 Safari/537.36"
}
r = s.get("https://httpbin.org/get", headers=headers)
Data
import request_curl
s = request_curl.Session()
# sending form data
form_data = {"key": "value"}
response = s.post("https://httpbin.org/post", data=form_data)
# sending json data
json_data = {"key": "value"}
response = s.post("https://httpbin.org/post", json=json_data)
Usage with Curl-Impersonate
To use request_curl with curl-impersonate, opt for our custom Docker image by either pulling or building it. The image comes with request_curl and curl-impersonate pre-installed. Check below for a demonstration on impersonating chrome101 tls-fingerprint and request_curl with our custom Docker Image.
Note: This feature is still considered experimental.
To pull the Docker image:
docker pull h3adex/request-curl-impersonate:0.0.2
docker run --rm -it h3adex/request-curl-impersonate
Example Python code for a target website:
import request_curl
from request_curl import CHROME_CIPHER_SUITE, CHROME_HEADERS
# impersonates chrome101
session = request_curl.Session(http2=True, cipher_suite=CHROME_CIPHER_SUITE, headers=CHROME_HEADERS)
response = session.get("https://google.com")
# <Response [200]>
Contributing
We welcome contributions through pull requests. Before making major changes, please open an issue to discuss your intended changes. Also, ensure to update relevant tests.
License
Ennis Blank Ennis.Blank@fau.de, Mauritz Uphoff Mauritz.Uphoff@hs-osnabrueck.de
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for request_curl-0.0.2-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2378327e7984b770222c19ef39e57f954c7ca251175e8fa7d7ee7bb84c8b4713 |
|
MD5 | 9c06d69283a8a390deeb420c9768af95 |
|
BLAKE2b-256 | f3d6fbbd9673ba7e73b24d31023fcba0ac3451d2b629995b72a94a2fd8e099cb |