Mucri

Quickly fetch a lot of pages/apis using python asyncio.

Installation

Only python 3.6+

pip isntall mucri

Usage

fetch_pages takes two args:

links : list of links to be fetched (example below) concurrency: how many requests to be send at a time (default 20)

from mucri import fetch_pages

# links can be a single string or a dict with specific instructions
links = [
    "http://meain.github.io",  # Can be just a url
    { "url": "http://somelink" }, # or a dict with url key
    { # for more complex stuff
        "url": "http://fakelink",
        "action": "get", # get | post
        "data": {},
        "headers": {},
        "resp_type": "text", # text | json | image
    }
]

results = fetch_pages(links) # fetches all of them asynchronously

Metadata

Release files for mucri 0.0.9

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for mucri 0.0.9
File	Size	Uploaded
mucri-0.0.9.tar.gz	2.4 kB	May 2, 2019	Details

Built distribution (wheel)

Table of built distributions (wheels) for mucri 0.0.9
File	Interpreter	ABI	Platform	Reset
mucri-0.0.9-py3-none-any.whl 2.7 kB May 2, 2019	Python 3	none	any	Details

Total release size: 5.2 kB

Release files / mucri-0.0.9.tar.gz

Download URL	mucri-0.0.9.tar.gz
Size	2.4 kB
Tags	Source
SHA-256 checksum How to use checksums	`e0bb7f3032b1c356105e617974ad115fd5705339b987abf7b093c2358e4cfc4e`
BLAKE2b-256 checksum How to use checksums	`92daacdc25a08852de079b6b3d15610d1ce663c7134ff4007f17f867ca18d1f9`
Upload date	May 2, 2019
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.8.0 requests-toolbelt/0.8.0 tqdm/4.25.0 CPython/3.7.3`

Release files / mucri-0.0.9-py3-none-any.whl

Download URL	mucri-0.0.9-py3-none-any.whl
Size	2.7 kB
Tags	Python 3
SHA-256 checksum How to use checksums	`14f695aacc380725cb03d643c98a9bd5f69ced8475d4ec84cfe7bd9a743d6d12`
BLAKE2b-256 checksum How to use checksums	`1ee5bc5cbd875e8336b336b45e90782bf0ce3b2c55895289547054abb1f4b7d6`
Upload date	May 2, 2019
Uploaded using Trusted Publishing? What is trusted publishing?	No
Uploaded via	`twine/1.11.0 pkginfo/1.4.2 requests/2.19.1 setuptools/40.8.0 requests-toolbelt/0.8.0 tqdm/4.25.0 CPython/3.7.3`