Skip to main content

a simple http-server mockup to test web crawler.

Project description

PEP8

HTTPserver-mock

a simple http-server mockup to test web crawler.

Installation

Run the folowing to install:

pip install HTTPserver-mock

Usage

from src.HTTPserver_mock import HTTPserver_mock
import noizze_crawler as nc


@HTTPserver_mock()
def test_crawler():
    (title, desc, image_url, html) = nc.crawler('http://localhost:8000/index.html')
    print('title:', title)
    print('desc:', desc)
    print('image_url:', image_url)
    print('html:', html[:1000])


if __name__ == '__main__':
    test_crawler()
$ python test.py
127.0.0.1 - - [07/Nov/2019 13:34:55] "GET /index.html HTTP/1.1" 200 -
1573101292.684394 httpserver_mock started
<h2>nope</h2>
1573101296.704611 httpserver_mock finished

ChangeLog

  • v2: PyPI published
  • v1: Test alpha

Project details


Release history Release notifications

This version

2

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for HTTPserver-mock, version 2
Filename, size File type Python version Upload date Hashes
Filename, size HTTPserver_mock-2-py3-none-any.whl (2.4 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size HTTPserver-mock-2.tar.gz (2.2 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN SignalFx SignalFx Supporter DigiCert DigiCert EV certificate StatusPage StatusPage Status page