Quickly scrape multiple pages
Project description
# Mucri
A python framework for extracting the same stuff from a lot of webpages.
Just a tiny tiny wrapper over `asyncio`!
## Installation
> Only python 3.6_+
```sh
pip isntall mucri
```
## Usage
```python
from mucri import fetch_links
links = [
{ "url": "http://somelink" },
{
"url": "http://fakelink",
"action": "get", # get | post
"data": {},
"headers": {},
"resp_type": "text", # text | json
}
]
results = fetch_links(links) # fetches all of them asynchronously
```
A python framework for extracting the same stuff from a lot of webpages.
Just a tiny tiny wrapper over `asyncio`!
## Installation
> Only python 3.6_+
```sh
pip isntall mucri
```
## Usage
```python
from mucri import fetch_links
links = [
{ "url": "http://somelink" },
{
"url": "http://fakelink",
"action": "get", # get | post
"data": {},
"headers": {},
"resp_type": "text", # text | json
}
]
results = fetch_links(links) # fetches all of them asynchronously
```
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
mucri-0.0.1.tar.gz
(1.4 kB
view hashes)
