Py3 version
Project description
# gopage
## Overview
Gopage is a Google search page crawler. It provides concise APIs to download Google search results, and parse them into readable data structures.
## APIs
***Crawler*** is responsible for crawling Google search page, given a query sentence. ***Parser*** aims at parsing the html content of a Google search page into a Python list, in which each element is a dict consisting of 'title' and 'content' of the corresponding Google snippet.
Quick start:
```python
from gopage import crawler
from gopage import parser
gpage = crawler.search('Tsinghua University')
snippets = parser.parse(gpage)
from pprint import pprint
pprint(snippets)
>>>
```
## Overview
Gopage is a Google search page crawler. It provides concise APIs to download Google search results, and parse them into readable data structures.
## APIs
***Crawler*** is responsible for crawling Google search page, given a query sentence. ***Parser*** aims at parsing the html content of a Google search page into a Python list, in which each element is a dict consisting of 'title' and 'content' of the corresponding Google snippet.
Quick start:
```python
from gopage import crawler
from gopage import parser
gpage = crawler.search('Tsinghua University')
snippets = parser.parse(gpage)
from pprint import pprint
pprint(snippets)
>>>
```
Project details
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
gopage-1.3.tar.gz
(2.9 kB
view hashes)
Built Distribution
gopage-1.3-py3.6.egg
(6.2 kB
view hashes)