Auto Generated by os-scrapy-cookiecutter
Project description
# lich_scrapy_hdfs_pipeline
Scrapy project auto generated by [os-scrapy-cookiecutter](https://github.com/cfhamlet/os-scrapy-cookiecutter).
## Project
This scrapy project is a python package generated by os-scrapy-cookiecutter.
You can run it as normal scrapy project with scrapy commands.
It is also a python package, the scaffolds can be used for formatting, testing, installing.
lint
` sh scripts/lint.sh `
test
` sh scripts/test.sh `
install
` python setup.py install `
example
You can run example spider:
` scrapy crawl example `
files
` . ├── lich_scrapy_hdfs_pipeline # scrapy project │ ├── __init__.py │ ├── items.py │ ├── middlewares.py │ ├── pipelines.py │ ├── settings.py │ └── spiders │ └── __init__.py ├── LICENSE # license file ├── MANIFEST.in # setup install package file ├── pytest.ini # pytest config file ├── README.md ├── requirements │ ├── requirements-lint.txt # requirements of format tools used by scripts/lint.sh and tox │ ├── requirements-test.txt # requirements of test used by tox │ └── requirements.txt # requirements of this project ├── scrapy.cfg # scrapy project entrypoint file ├── scripts │ ├── test.sh # run test │ └── lint.sh # format the source file ├── setup.cfg # setup tool config file ├── setup.py # setup tool ├── tests │ ├── __init__.py │ └── test_scrapy_check.py # unit test with scrapy check └── tox.ini # tox config file `
## Install
` python setup.py install `
## Usage
` scrapy -h `
## Unit Tests
` sh scripts/test.sh `
## License
MIT licensed.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Hashes for lich_scrapy_hdfs_pipeline-0.0.1.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 8bfa68c870af3150230560b279a04738432ab28c65a5acc63159de9af2cb5ee0 |
|
MD5 | b6b034fedff34d34b6bae1dac7620c4c |
|
BLAKE2b-256 | d91d5b25b9b34bf41d5e035ea98f12956b1ea7919f8a7c5a2f9636edf052e44c |