通过git安装

由于代码依赖了pyquery，安装前请确保libxslt-devel libxml2-devel已被安装

    sudo apt-get install libxml2-dev
    sudo apt-get install libxslt1-dev

然后请确保安装了[setuptools](https://pypi.python.org/pypi/setuptools#downloads "setuptools"), Ubuntu下你可以：

    sudo apt-get install python-setuptools

然后从github clone source到本地

    $ git clone https://github.com/nyankosama/crawl-me.git
    $ cd crawl-me/
    $ sudo python setup.py install

首先你需要安装[python2.7](https://www.python.org/download/releases/2.7.7/)和[pip](https://pip.pypa.io/en/latest/installing.html)，python2.7可以通过windows installer安装。安装pip首先下载[get-pip.py](https://bootstrap.pypa.io/get-pip.py)， 然后执行下面命令。

    python get-pip.py

然后，你需要安装pyquery的所依赖的lxml，选择对应的[lxml installer](https://pypi.python.org/pypi/lxml/3.3.5#downloads)下载并安装

最后从github clone 到本地

    $ git clone https://github.com/nyankosama/crawl-me.git
    $ cd crawl-me/
    $ sudo python setup.py install

在使用crawl-me之前，请确保把{$python-home}/Scripts/ 加入Windows环境变量中

Examples

1. 下载gamersky下的http://www.gamersky.com/ent/201404/352055.shtml 的第1页到第10页的所有图片到当前目录的gamersky-crawl文件夹下

   crawl-me gamersky http://www.gamersky.com/ent/201404/352055.shtml ./gamersky-crawl 1 10

2. 一键下载P站藤原桑的所有作品到pixiv-crawl文件夹（藤原桑的id是27517）

   crawl-me pixiv 27517 ./pixiv-crawl <your pixiv loginid> <your password>

Command line options

1. general help

   $ crawl-me -h
   
   usage: crawl-me [-h] plugin
   
   positional arguments:
       plugin      plugin the crawler uses
   
   optional arguments:
       -h, --help  show this help message and exit
   
   available plugins:
   ----gamersky
   ----pixiv

2. gamersky

   $ crawl-me gamersky -h
   
   usage: crawl-me [-h] plugin authorId savePath pixivId password
   
   positional arguments:
       plugin      plugin the crawler uses
       authorId    the author id you want to crawl
       savePath    the path where the imgs ars saved
       pixivId     your pixiv login id
       password    your pixiv login password
   
   optional arguments:
       -h, --help  show this help message and exit

3. pixiv

   $ crawl-me pixiv -h
   
   usage: crawl-me [-h] plugin authorId savePath pixivId password
   
   positional arguments:
       plugin      plugin the crawler uses
       authorId    the author id you want to crawl
       savePath    the path where the imgs ars saved
       pixivId     your pixiv login id
       password    your pixiv login password
   
   optional arguments:
       -h, --help  show this help message and exit

0.1.4dev-20140611

Date: 2014-06-11

• modify the README.md. Now it is consistent with rst format to display on pypi

0.1.4dev-20140610

Date: 2014-06-10

• add support for installing from pip

0.1.4dev3

Date: 2014-06-10

• bug fix

• fix the binary write problem in windows platform

0.1.4dev2

Date: 2014-06-10

• add setuptools install support

0.1.4dev1

Date: 2014-06-09

• bug fix

• rangedownloader:http range-headers may not be supported

0.1.3

Date: 2014-06-07

• do some refactory

• add conf dictionary

0.1.2

Date: 2014-06-06

• add plugin

• pixiv

0.1.1

Date: 2014-06-05

• add plugin

• gamersky

0.0.1

Date: 2014-06-05

• init the project