I initially thought of creating an extension to help with the situation. Unfortunately an extension would never have the seamless feel of wget or curl for the unfortunate ones like me who are in a relationship with the terminal. Also an extension cannot be used in those quick and dirty bash/perl/python scripts.
pip install pyscrape
- Clone https://github.com/animeshkundu/pyscrape
- pip install -r requirements.txt
- python setup.py install
## Test 1. pyscrape http://www.google.co.in/ 2. pyrun -p 1234; curl localhost:1234/scrape?url=http://www.google.co.in/
Improvements are welcome.
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size||File type||Python version||Upload date||Hashes|
|Filename, size scrapejs-0.0.1.1-py2-none-any.whl (6.6 kB)||File type Wheel||Python version py2||Upload date||Hashes View hashes|
|Filename, size scrapejs-0.0.1.1.tar.gz (3.7 kB)||File type Source||Python version None||Upload date||Hashes View hashes|
Hashes for scrapejs-0.0.1.1-py2-none-any.whl