Skip to main content

a small web crawler for the pastebin.com website

Project description

https://travis-ci.com/shlomikushchi/Simple-Pastebin-Parser.svg?branch=master

Simple-Pastebin-Parser

this is a simpler parser for the pastebin.com website.

it will iterate posts and parse their elements using lxml

installation:

pip install simple-pastebin-parser

example usage

import simple_pastebin_parser

for paste in simple_pastebin_parser.get_pastes():
    print("Title: ", paste.Title)
    print("Author: ", paste.Author)
    print("date: ", paste.Date)
    print("Content: ")
    print(paste.Content)
    print("*" * 20)

Release notes:

v0.1.0 - P.O.C

initial proof of concept. nothing special, just doing the dirty work of parsing the posts.

how to execute: 1. create a virtual env of python 3.6 2. install requirements 3. run python poc.py

v0.2.5 (2020-03-07)

  • integration with travis.ci

v0.2.6 (2020-03-07)

  • changing the POC code to work with installed pypi package

v0.3.0 (2020-03-07)

  • created the Paste() object for pastebin posts
  • ability to stream data

v0.3.3 (2020-03-07)

  • small fixes

v0.3.5 (2020-03-07)

  • update README

v0.4.0 (2020-03-08)

  • added documentation
  • cleaned most pep8 issues
  • some tests

v0.5.0 (2020-03-08)

  • parse date in UTC
  • add some logs
  • add id to Paste()

v0.5.2 (2020-03-09)

  • cleanups

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for simple-pastebin-parser, version 0.5.2
Filename, size File type Python version Upload date Hashes
Filename, size simple_pastebin_parser-0.5.2-py2.py3-none-any.whl (5.6 kB) File type Wheel Python version py2.py3 Upload date Hashes View
Filename, size simple_pastebin_parser-0.5.2.tar.gz (6.9 kB) File type Source Python version None Upload date Hashes View

Supported by

Pingdom Pingdom Monitoring Google Google Object Storage and Download Analytics Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page