A Scrapy addon that allows to access arguments via the dot
Project description
Title
Description
Simplifies the scrapy items, letting you access the attriburtes via the dot
The regular bulky way to do it:
regular_scrapy_item['some_field'] = 42
print(regular_scrapy_item.get('some_field'))
The simple dot-items way:
scrapy_dot_item.some_field = 42
print(scrapy_dot_item.some_field)
Installation
pip install scrapy-dot-items
Usage
Apply to a single scrapy item class
You can add functionality with the dot_item decorator to a single class
from scrapy_dot_items import dot_item
@dot_item
class RealEstateItem(scrapy.Item):
price = scrapy.Field()
dot_scrapy_item = RealEstateItem()
dot_scrapy_item.price = 1000
print(dot_scrapy_item.price) # prints 1000
Apply to all scrapy items
You can apply this functionality globally
from scrapy_dot_items import dot_items_globally
dot_items_globally() # now every scrapy.Item class will have this functionality
class RealEstateItem(scrapy.Item):
price = scrapy.Field()
dot_scrapy_item = RealEstateItem()
dot_scrapy_item.price = 1000
print(dot_scrapy_item.price) # prints 1000
Backwards compatibility
scrapy-dot-items are backwards compatible. You can install it into your old project and mix regular and dot style.
dot_scrapy_item['price'] = 2000 # you can still set and get the items the regular way too
print(dot_scrapy_item.get('price')) # prints 2000
print(dot_scrapy_item.price) # prints 2000
For developers
This project uses pipenv instead of pip. Setu
- intall pipenv with 'pip install pipenv'
- create a virtual environment using pipenv with 'pipenv shell' in the root directory
- install the dependencies with 'pipenv install'
Attention: Please install all packages with 'pipenv install <package_name>'. Do NOT use 'pip install ...'. The same for unistalling 'pipenv uninstall <package_name>'
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Close
Hashes for scrapy_dot_items-0.1.15-py3-none-any.whl
Algorithm | Hash digest | |
---|---|---|
SHA256 | 3e2ea5a0177027d0740e97be3f56ba0ce2c56725dba15a6287ddc90d920a038d |
|
MD5 | 66173da1ce58bdbd41f13386d35bc597 |
|
BLAKE2b-256 | 5a76b76c15666c9c815e5ca727b68d328486fa8174425f3ec48ed1c69b17dbe3 |