Web Data Extraction Library Written in Python
Project description
Wextracto is a toolkit for command-line web data extraction.
Installation
$ pip install wextracto
Kicking the Tyres
$ echo -e "[wex]\nsitemaps=wex.sitemaps:urls_from_sitemaps" > entry_points.txt
$ wex "http://www.ebay.com/robots.txt"
Documentation
The documentation can be found here:
Release History
0.9.1 (2016-04-26)
Fix bug when using nested Cache objects
0.9.0 (2016-04-16)
Add support for reading WARC response format
0.8.8 (2016-04-11)
Fix bug in handling of invalid numeric character references
0.8.5 (2015-12-07)
Allow utf-8 in HTTP headers (only applies to PY2)
0.8.3 (2015-09-23)
Fix bug in HTTP decode caused by magic bytes handling.
0.8.2 (2015-09-21)
Add magic_bytes to Response for more reliable wex.http:decode behaviour.
0.7.9 (2015-08-18)
Re-worked encoding for HTML to pre-parse
0.7 (2015-06-04)
Better proxy support
0.4 (2015-02-12)
Now we flatten labels and values.
href and src become href_url and src_url.
0.3 (2014-12-29)
Some API changes + switch to “tab-separated JSON”.
0.2.2 (2014-10-24)
Uploaded sdist to PyPI for “pip install wextracto” simplicity.
0.1 (2014-10-16)
Initial release as open source
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for Wextracto-0.9.1-py2.py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 7bd3848489deecd83b1c4939724d7edad02422adb222ac0030dbef2652d852b4 |
|
MD5 | cea48b19e462c327ec0857d293b4de07 |
|
BLAKE2b-256 | 02778b1b83a365294683a7650763428f62873479b86b96b1758c23b8cc3211a0 |