A high-level Python Screen Scraping framework
Scrapy is a fast high-level screen scraping and web crawling framework, used to crawl websites and extract structured data from their pages. It can be used for a wide range of purposes, from data mining to monitoring and automated testing.
For more information including a list of features check the Scrapy homepage at: http://scrapy.org
- Python 2.7
- Works on Linux, Windows, Mac OSX, BSD
The quick way:
pip install scrapy
For more details see the install section in the documentation: http://doc.scrapy.org/en/latest/intro/install.html
You can download the latest stable and development releases from: http://scrapy.org/download/
Documentation is available online at http://doc.scrapy.org/ and in the docs directory.
Community (blog, twitter, mail list, IRC)
Companies using Scrapy
Release history Release notifications
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
|Filename, size & hash SHA256 hash help||File type||Python version||Upload date|
|Scrapy-0.24.0-py2-none-any.whl (501.9 kB) Copy SHA256 hash SHA256||Wheel||2.7||Jun 26, 2014|
|Scrapy-0.24.0.tar.gz (768.8 kB) Copy SHA256 hash SHA256||Source||None||Jun 26, 2014|