html_jumping

Welcome to HTML-Jumping

Author:

Daniel Perez Rada <@dperezrada>

What?

Allows to get an HTML, coming from several previous URLs. Sometimes this is needed to get webpages that requires cookies or a HTTP referrer to get a certain page.

Pre-requisites

You will need:

httplib2
http://socksipy.sourceforge.net/ (if you want to use a proxy)

To run the test you will also need:

lxml

Example

No proxy

from html_jumping import HtmlJumping
handler = HtmlJumping()
urls = [
    {
        'url': 'http://pypi.python.org/pypi',
        'method': 'GET'
    },
    {
        'url': 'http://pypi.python.org/pypi',
        'method': 'GET',
        'body': {
            'term': 'html_jumping',
            ':action': 'search',
            'submit': 'search'
        }
    }
]
received_header, received_content = handler.get(urls)

With proxy

Allow you to use a HTTP proxy, you will need to install the socksipy library.

from html_jumping import HtmlJumping
handler = HtmlJumping()
urls = [
    {
        'url': 'http://pypi.python.org/pypi',
        'method': 'GET'
    },
    {
        'url': 'http://pypi.python.org/pypi',
        'method': 'GET',
        'body': {
            'term': 'html_jumping',
            ':action': 'search',
            'submit': 'search'
        }
    }
]
received_header, received_content = handler.get(
    urls,
    proxy_info = {'host': '127.0.0.1', 'port': '8081'}
)

With permanent headers

This will sent in each call the headers ‘Accept-Language’.

from html_jumping import HtmlJumping
handler = HtmlJumping()
urls = [
    {
        'url': 'http://pypi.python.org/pypi',
        'method': 'GET'
    },
    {
        'url': 'http://pypi.python.org/pypi',
        'method': 'GET',
        'body': {
            'term': 'html_jumping',
            ':action': 'search',
            'submit': 'search'
        }
    }
]
received_header, received_content = handler.get(
    urls,
    permanent_headers = {'Accept-Language': 'es, en-cl;q=0.5'}
)

Tests

Run

>> nosetests

Release files for html_jumping 0.2.4

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for html_jumping 0.2.4
File	Size	Uploaded
html_jumping-0.2.4.tar.gz	3.7 kB	Aug 25, 2012	Details

Release files / html_jumping-0.2.4.tar.gz

Download URL	html_jumping-0.2.4.tar.gz
Size	3.7 kB
Tags	Source
SHA-256 checksum How to use checksums	`8491722577a206530b09b80ea741e64fe3d96df8ac2e9c3683eb00f43a2ba5cf`
BLAKE2b-256 checksum How to use checksums	`143696a45ddfca6766c29d18860072d0eb1f6b96c12eea6467e07008bda90857`
Upload date	Aug 25, 2012
Uploaded using Trusted Publishing? What is trusted publishing?	No