Skip to main content

Simple module to perform asynchronous HTTP requests using asyncio and aiohttp

Project description

Latest PyPI package version

This is asyhttp, a simple module to perform asynchronous HTTP requests using asyncio and aiohttp.

It provides a trivial way to perform a set of async HTTP requests.

Features

  • Proxy support

  • Custom headers

  • Allow redirects

  • Use TLS

How to use loop()

asyhttp loop() accepts some args

  • urls a set of dictionaries, each dict represent an HTTP request.

  • proxy (str) proxt URL, str (optional).

  • process_out a user defined function that can be used to process the response of each HTTP request. It will be called by the async function that perform each HTTP request, as soon as the response arrive (optional).

  • redirects (bool) – If set to True, follow redirects. False by default (optional).

  • verify_tls (bool) True for check TLS cert validation, False by default (optional).

Getting started

from asyhttp import loop

requests = [    {'url':'http://exam.ple/page.html', 'method':'GET'},
                {'url':'http://exam.ple/page.html', 'method':'POST', 'body' : 'blabla'}
]
loop(urls=requests)

Use cases

asyhttp loop can be useful to write quick bruteforces against vulnerable systems or as a core for tools like dirfister.

An early version of this code comes from https://pawelmhm.github.io/asyncio/python/aiohttp/2016/04/22/asyncio-aiohttp.html

Docs

Process HTTP responses

By default, asyhttp loop print on stdout HTTP status code and reason for each response received. You can override its default behavior writing custom code to process the response your HTTP requests. Your code has to be written in a function and passed to loop as a kwarg called process_out. That function will be called by the async function that perform each of your HTTP requests, as soon as the response arrive.

In your custom code you can process: - url: url of the HTTP request - return_code - reason - resp_body - user_data

Example

pip install asyhttp
from asyhttp import loop
requests = [{'url':'http://exam.ple/page.html', 'method':'GET'}]
loop(urls=requests)

Example

from asyhttp import loop

def process_output(url,return_code,reason,resp_body,user_data):
        if return_code == 200:
                sys.stdout.write("url")

requests = [{'url':'http://exam.ple/page.html', 'method':'GET'}]
loop(urls=requests,process_out=process_output)

asyhttp loop’s args

  • urls

  • process_out

  • proxy

  • verify_tls

  • redirects

Supported HTTP methods

  • GET

  • POST

  • HEAD

HTTP requests format

{'method':'GET', 'url':'http://exam.ple/page.html'}
{'method':'POST', 'url':'http://exam.ple/page.html','body':'blablabl=balbal'}
{'url':'http://exam.ple/page.html', 'method':'GET', 'headers' : 'X-Custom-Header:YEAH'}

Proxy support

loop(urls=url_dict_list,proxy="http://127.0.0.1:8080")

Custom headers

To add HTTP headers to a request, pass them as a dict.

{'url':'http://exam.ple/page.html', 'method':'GET', 'headers' : {'User-agent':'YEAH'}}

Allow redirects

False by default

loop(urls=requests,process_out=process_response,redirects=True)

Verify TLS

False by default

loop(urls=requests,process_out=process_response,verify_tls=True)

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

asyhttp-0.2.tar.gz (3.6 kB view details)

Uploaded Source

File details

Details for the file asyhttp-0.2.tar.gz.

File metadata

  • Download URL: asyhttp-0.2.tar.gz
  • Upload date:
  • Size: 3.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: Python-urllib/3.8

File hashes

Hashes for asyhttp-0.2.tar.gz
Algorithm Hash digest
SHA256 393ba44f6f7d958ca3e43d334c80b9305149afcd521f6087f967b9bab7b7a43a
MD5 3dc4ea5a4bcbd69614a10f968a82cc50
BLAKE2b-256 ece681578154e0a2e2e68c27d14edb43ee5c5714a570c2c852d599eabeff5a07

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page