Skip to main content
Help us improve PyPI by participating in user testing. All experience levels needed!

HTML Parsing Macro things for Humans.

Project description

https://travis-ci.org/erinxocon/requests-html-macros.svg?branch=master https://img.shields.io/pypi/v/requests-html-macros.svg?maxAge=2592000 https://img.shields.io/pypi/l/requests-html-macros.svg?maxAge=2592000

Requests-Html-Macros is a little sugar on top of an already great html parseing library Requests-Html

This library aims to help make parsing the web a bit easier than it already is with Requests-Html! Create macros that can be reused over different web sites/sessions! Could you do this by hand with requests-html, yes probably pretty simply, but I only realized that liek half way through developing this library and then was just like screw it let’s push it out anyways!

Example

from time import sleep

from requests_html_macro import Macro
from requests_html import HTMLSession

# Create a standard requests-html session
session = HTMLSession()
response = session.get('http://python.org')

# Create a macro with the response
macro = Macro(response=response)

# Create a macro that uses the parse library to search through the html
@macro.search_pattern('Python is a {} language', first=True)
def foo(data):
    print(data[0])

# Creates a macro that uses a css selector
@macro.css_selector('#about', first=True)
def foo1(data):
    print(data.text)


@macro.xpath('//a', first=True)
def foo2(data):
    print(data)

while True:
    macro.parse()
    sleep(30)
    macro.response = session.get('http://python.org')

To Install

$ pip install requests-html-macro

Project details


Release history Release notifications

This version
History Node

0.1.1

History Node

0.1.0

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Filename, size & hash SHA256 hash help File type Python version Upload date
requests_html_macros-0.1.1-py2.py3-none-any.whl (4.8 kB) Copy SHA256 hash SHA256 Wheel py2.py3 Mar 13, 2018
requests-html-macros-0.1.1.tar.gz (4.0 kB) Copy SHA256 hash SHA256 Source None Mar 13, 2018

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging CloudAMQP CloudAMQP RabbitMQ AWS AWS Cloud computing Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page