Item with general/unknown/dynamic fields
Project description
scrapy-item
Item with general/unknown/dynamic fields. Variation of https://github.com/WilliamKinaan/ScrapyDynamicItems - extracting only essential part. See CHANGELOG.md for detail description.
Getting Help
QuickStart
python3 -m pip install -U scrapy-item
Installing from Github
python3 -m pip install -U https://github.com/alex-ber/scrapy-item/archive/master.zip
Optionally installing tests requirements.
python3 -m pip install -U https://github.com/alex-ber/scrapy-item/archive/master.zip#egg=alex-ber-utils[tests]
Or explicitly:
wget https://github.com/alex-ber/scrapy-item/archive/master.zip -O master.zip; unzip master.zip; rm master.zip
And then installing from source (see below).
Installing from source
python3 -m pip install . # only installs "required"
python3 -m pip install .[tests] # installs dependencies for tests
Alternatively you install install from requirements file:
python3 -m pip install -r requirements.txt # only installs "required"
python3 -m pip install -r requirements-tests.txt # installs dependencies for tests
From the directory with setup.py
python3 setup.py test #run all tests
or
pytest
Installing new version
See https://docs.python.org/3.1/distutils/uploading.html
python3 setup.py sdist upload
Requirements
scrapy-item requires the following modules.
- Python 3.6+
Changelog
All notable changes to this project will be documented in this file.
#https://pypi.org/manage/project/scrapy-state/releases/
[Unrelased]
[0.0.1] - 01/07/2020
Added
GeneralItem
class inalexber.scrapyitem
module. Item with general/unknown/dynamic fields. Variation of [https://github.com/WilliamKinaan/ScrapyDynamicItems] - extracting only essential part.- See [https://medium.com/@alex_ber/scrapy-item-with-general-fields-7552bd6e4622] for description.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
scrapy-item-0.0.1.tar.gz
(5.6 kB
view hashes)
Built Distribution
Close
Hashes for scrapy_item-0.0.1-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 4e3eae5a8c9cb1accba1f3fe288f2be5df2d21dd3525b02b6df17cb0e499d1a4 |
|
MD5 | 4224c7a71ced78d92192f522ae80276e |
|
BLAKE2b-256 | 06b7d1fb71fb3c07338e8b6183a408e233325339f5504a6f27c37e29d23464fd |