pafer 0.9.7

Features

• Parse HTML into structured tag / text / metadata results
• CSS-style selectors (#id, .class, tag name)
• Whitelist-based sanitization
• Minification with comment stripping
• Link and table extraction
• LRU result caching with TTL
• RSS 2.0 feed parsing
• JSON / CSV export
• CLI tool
• Standard library only, no third-party dependencies

Installation

pip install pafer

Quickstart

from pafer import HTMLParser

html = '<div class="post"><h1>Title</h1><a href="/about">About</a></div>'

p = HTMLParser()
result = p.parse(html)

result['tags']        # list of {name, attributes, content, rows?}
result['metadata']    # {'title': ...}
result['doctype']     # '<!DOCTYPE ...>' or None

p.select(html, '.post')    # match by #id, .class or tag name
p.sanitize(html)           # keep only allowed tags
p.minify(html)             # collapse whitespace, strip comments
p.extract_links(html)      # [{'url': ..., 'text': ..., 'attributes': ...}]

Enable the parsed-result cache with HTMLParser(use_cache=True).

Configuration

from pafer import Config, load_config, save_config

cfg = Config({'strip_whitespace': False, 'cache_size': 100})
save_config(cfg, 'my.pkl')
cfg = load_config('my.pkl')

Default settings

Caching

pafer.cache.LRUCache is an in-memory LRU cache with TTL expiry:

from pafer.cache import LRUCache

cache = LRUCache(max_size=100, ttl_seconds=300)
cache.set('key', value)
cache.get('key')

RSS feeds

from pafer.feed import FeedParser

items = FeedParser().parse_rss(xml_content)
items[0]['title']       # 'title', 'link', 'description', 'pubDate'

Exporting

from pafer.exporters import DataExporter

DataExporter.to_json(data)    # JSON string with 2-space indent
DataExporter.to_csv(rows)     # CSV from a list of rows

CLI

python -m pafer.cli parse -f input.html --minify
python -m pafer.cli sanitize -f input.html

Exceptions

HTMLParserError (base), SanitizationError, SelectorSyntaxError, ConfigLoadError.

LICENSE

MIT - Enjoy