Python 3.6
scrapy-mysql-pipeline
Asynchronous mysql Scrapy item pipeline
Installation
pip install scrapy-mysql-pipelineConfiguration
Add pipeline
ITEM_PIPELINES = {
'scrapy_mysql_pipeline.MySQLPipeline': 300,
}Default values:
MYSQL_HOST = 'localhost'
MYSQL_PORT = 3306
MYSQL_USER = None
MYSQL_PASSWORD = ''
MYSQL_DB = None
MYSQL_TABLE = None
MYSQL_UPSERT = False
MYSQL_RETRIES = 3
MYSQL_CLOSE_ON_ERROR = True
MYSQL_CHARSET = 'utf8'MYSQL_USER, MYSQL_PASSWORD, MYSQL_DB and MYSQL_TABLE, variables must be set in settings.py
1 maintainer
Metadata
1 maintainer
Release files for scrapy-mysql-pipeline 2019.7.19
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| scrapy-mysql-pipeline-2019.7.19.tar.gz | 4.6 kB | Details |
Release files / scrapy-mysql-pipeline-2019.7.19.tar.gz
| Download URL | scrapy-mysql-pipeline-2019.7.19.tar.gz |
|---|---|
| Size | 4.6 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
dc8a183727f2a79e3391461cec5970af62f4dbf44dd22d214860404f35853a4b
|
|
BLAKE2b-256 checksum How to use checksums |
8cd0db760eaca71d6e9bb6e1859ce83402fe0f1b57ba6b00ffdb65e54b68df15
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/1.13.0 pkginfo/1.5.0.1 requests/2.22.0 setuptools/41.0.1 requests-toolbelt/0.9.1 tqdm/4.32.1 CPython/3.7.3
|
