Skip to main content

Python programmatic web browser to fetch data and test web sites

Project description

Copyright 2009-2018 Sloft http://bitbucket.org/sloft/pynav

Name: pynav
Version: 1.0
Summary: Python programmatic web browser to fetch data and test web sites
Home-page: http://bitbucket.org/sloft/pynav/
Author: sloft
License: LGPL
Download-URL: http://bitbucket.org/sloft/pynav/downloads/
Description: Python programmatic web browser to fetch data and test web sites
________________________________________________________________

Features:

-Post authentication
-User agent support
-Automatic cookie handling
-HTTP Basic Authentication support
-HTTPS support
-Proxy support
-Timeout support
-Reg exp searching
-Links fetching with reg exp filter
-History (pages, posts and responses)
-Save and load history from a file and replay navigation
-Random sleep time beetween pages
-Errors handling
-Content type filters
-Check 404 urls
-Check resource datetime
-Handle robots.txt
_______________________________________________________________

Bug reporting and features asking are welcome.
Use the the bug tracker: http://bitbucket.org/sloft/pynav/issues?status=new&status=open


Python version: 3.5+

INSTALLATION:

- With pip:
pip3 install pynav

- From sources:
python3 setup.py install


2018-10-11 Pynav 1.0

* New: pynav ported to Python 3
* New: Python 2.6 is no longer supported, Python 3.5 minimum is now required.
* New: Add useragent.py containing an updated user agent list, update Browser to use it
* New: Add Type Hints for IDE completion in Browser
* New : formdumper deleted because ClientForm does not meet Python 3 requirements
* New : 3 Response methods are no longer supported : Response.dump_form(), Response.dump_forms(), Response.formDumper()

* Qual: Migrate Python 2.6 code to Python 3.5
* Qual: Browser.check_404() renamed to Browser.is_404()
* Qual: # -*- coding=utf-8 -*- removed in all files because utf-8 is the default source encoding in python 3

* Fix: Browser.download() bug when url is the root url + rename built-in name bytes in Browser._humanize_bytes()
* Fix: header datetime conversion regression in Browser.check_new_resource(), Response.date and Response.last_modified
* Fix: relative url bug in Browser.response.images with urllib.parse.urljoin



Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

pynav-1.0.tar.gz (10.4 kB view details)

Uploaded Source

Built Distribution

pynav-1.0-py3-none-any.whl (12.3 kB view details)

Uploaded Python 3

File details

Details for the file pynav-1.0.tar.gz.

File metadata

  • Download URL: pynav-1.0.tar.gz
  • Upload date:
  • Size: 10.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.6.6

File hashes

Hashes for pynav-1.0.tar.gz
Algorithm Hash digest
SHA256 83f98f1750ae597ea555625facaaf48e73668fd452fbf780ac5ecbfd5138302e
MD5 4db75dccbe9ae03ee21f125e26d242fb
BLAKE2b-256 1225533528fb9314fc05dd4e621f8e044d27a7267c73e311b4a76c3b574fa75d

See more details on using hashes here.

File details

Details for the file pynav-1.0-py3-none-any.whl.

File metadata

  • Download URL: pynav-1.0-py3-none-any.whl
  • Upload date:
  • Size: 12.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.19.1 setuptools/40.4.3 requests-toolbelt/0.8.0 tqdm/4.26.0 CPython/3.6.6

File hashes

Hashes for pynav-1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 01fab4cfaa1e1940f45cb35ed23fe2a1d495194470f12372bd9622b7c809a764
MD5 05aaea5994deb8fcfbf5a50f05db26eb
BLAKE2b-256 779d80ef1078d0d0aa1a14d1a08ee9671bb121797bf4f87c96ee4a957087e3ed

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page