Asynchronous mysql Scrapy item pipeline
Project description
scrapy-mysql-pipeline
Asynchronous mysql Scrapy item pipeline
Installation
pip install scrapy-mysql-pipeline
Configuration
Add pipeline
ITEM_PIPELINES = {
'scrapy_mysql_pipeline.MySQLPipeline': 300,
}
Default values:
MYSQL_HOST = 'localhost'
MYSQL_PORT = 3306
MYSQL_USER = None
MYSQL_PASSWORD = ''
MYSQL_DB = None
MYSQL_TABLE = None
MYSQL_UPSERT = False
MYSQL_RETRIES = 3
MYSQL_CLOSE_ON_ERROR = True
MYSQL_TABLE variable must be set in settings.py
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Close
Hashes for scrapy-mysql-pipeline-2017.10.10.tar.gz
Algorithm | Hash digest | |
---|---|---|
SHA256 | 37a211439fce85bef7801582721f2f4b7c015d48a252c6972bd3a2f83c267d5e |
|
MD5 | a6b60024ad9fe383d985dc5937584775 |
|
BLAKE2b-256 | 82327a14922ef45ff010c3d0655ed4fdab15288b59cbf2244a8923cc73ea4b1a |