Item with general/unknown/dynamic fields
Project description
scrapy-item
Item with general/unknown/dynamic fields. Variation of https://github.com/WilliamKinaan/ScrapyDynamicItems - extracting only essential part. See [https://medium.com/@alex_ber/scrapy-item-with-general-fields-7552bd6e4622] for description. See CHANGELOG.md for detail description.
Getting Help
QuickStart
python3 -m pip install -U scrapy-item
Installing from Github
python3 -m pip install -U https://github.com/alex-ber/scrapy-item/archive/master.zip
Optionally installing tests requirements.
python3 -m pip install -U https://github.com/alex-ber/scrapy-item/archive/master.zip#egg=alex-ber-utils[tests]
Or explicitly:
wget https://github.com/alex-ber/scrapy-item/archive/master.zip -O master.zip; unzip master.zip; rm master.zip
And then installing from source (see below).
Installing from source
python3 -m pip install -r req.txt # only installs "required" (relaxed)
python3 -m pip install . # only installs "required"
python3 -m pip install .[tests] # installs dependencies for tests
Alternatively you install install from requirements file:
python3 -m pip install -r requirements.txt # only installs "required"
python3 -m pip install -r requirements-tests.txt # installs dependencies for tests
From the directory with setup.py
python3 setup.py test #run all tests
or
pytest
Installing new version
See https://docs.python.org/3.1/distutils/uploading.html
python3 setup.py sdist upload
Requirements
scrapy-item requires the following modules.
- Python 3.6+
Changelog
Item with general/unknown/dynamic fields. Variation of https://github.com/WilliamKinaan/ScrapyDynamicItems - extracting only essential part. See [https://medium.com/@alex_ber/scrapy-item-with-general-fields-7552bd6e4622] for description.
All notable changes to this project will be documented in this file.
#https://pypi.org/manage/project/scrapy-state/releases/
[Unrelased]
[0.0.2] - 01/07/2020
Added
- Unit-test for
GeneralItem
class inalexber.scrapyitem
module is added.
[0.0.1] - 01/07/2020
Added
GeneralItem
class inalexber.scrapyitem
module. Item with general/unknown/dynamic fields. Variation of [https://github.com/WilliamKinaan/ScrapyDynamicItems] - extracting only essential part.- See [https://medium.com/@alex_ber/scrapy-item-with-general-fields-7552bd6e4622] for description.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Hashes for scrapy_item-0.0.3-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 350ff564e235edeade63846f63215727767f8761365bb9a3f77b4cde094d60f5 |
|
MD5 | acb657ffcafab1edc13f9ccdfcdc4f35 |
|
BLAKE2b-256 | 0848d01caf0ef3cfccd03ca7370bda71a2a9f468f9dc2b5fe9aa31e3d359d7e3 |