Quickly scrape multiple pages
Project description
# Mucri
Quickly fetch a lot of pages/apis using python `asyncio`.
## Installation
> Only python 3.6+
```sh
pip isntall mucri
```
## Usage
```python
from mucri import fetch_links
links = [
"http://meain.github.io",
{ "url": "http://somelink" },
{
"url": "http://fakelink",
"action": "get", # get | post
"data": {},
"headers": {},
"resp_type": "text", # text | json
}
]
results = fetch_links(links) # fetches all of them asynchronously
```
Quickly fetch a lot of pages/apis using python `asyncio`.
## Installation
> Only python 3.6+
```sh
pip isntall mucri
```
## Usage
```python
from mucri import fetch_links
links = [
"http://meain.github.io",
{ "url": "http://somelink" },
{
"url": "http://fakelink",
"action": "get", # get | post
"data": {},
"headers": {},
"resp_type": "text", # text | json
}
]
results = fetch_links(links) # fetches all of them asynchronously
```
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mucri-0.0.2.tar.gz
(1.4 kB
view hashes)