lightparser 0.1.4

A lightweight parser with XPath support, Scrapy-like Items, and flexible output options.

lightparser

A lightweight parsing library inspired by Scrapy.

Features

• Scrapy-like 'Selector' object for Xpath parsing.
• Lightweight 'Item' class for structured data.
• Automatic CSV/JSON export via '-o' or '-O' argument.
• '-O' argument to overwrite the existing file.
• '-o' argument to append the existing file.
• No framework lock-in.

Installation

pip install lightparser

Usage

import requests
from lightparser import Selector, Item, yield_item

response = requests.get("https://example.com")
selector = Selector(response.text)

for product in selector.xpath('//div[@class="product"]'):
    item = Item()
    item["title"] = product.xpath(".//h2/text()").get()
    item["price"] = product.xpath(".//span[@class='price']/text()").get()
    yield_item(item)

Command-line Usage

python my_script.py -o output.csv