Skip to main content

a small web crawler for the pastebin.com website

Project description

https://travis-ci.com/shlomikushchi/Simple-Pastebin-Parser.svg?branch=master

Simple-Pastebin-Parser

this is a simpler parser for the pastebin.com website.

it will iterate posts and parse their elements using lxml

installation:

pip install simple-pastebin-parser

example usage

import simple_pastebin_parser

for paste in simple_pastebin_parser.get_pastes():
    print("Title: ", paste.Title)
    print("Author: ", paste.Author)
    print("date: ", paste.Date)
    print("Content: ")
    print(paste.Content)
    print("*" * 20)

Release notes:

v0.1.0 - P.O.C

initial proof of concept. nothing special, just doing the dirty work of parsing the posts.

how to execute: 1. create a virtual env of python 3.6 2. install requirements 3. run python poc.py

v0.2.5 (2020-03-07)

  • integration with travis.ci

v0.2.6 (2020-03-07)

  • changing the POC code to work with installed pypi package

v0.3.0 (2020-03-07)

  • created the Paste() object for pastebin posts

  • ability to stream data

v0.3.3 (2020-03-07)

  • small fixes

v0.3.5 (2020-03-07)

  • update README

v0.4.0 (2020-03-08)

  • added documentation

  • cleaned most pep8 issues

  • some tests

v0.5.0 (2020-03-08)

  • parse date in UTC

  • add some logs

  • add id to Paste()

v0.5.2 (2020-03-09)

  • cleanups

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

simple_pastebin_parser-0.5.2.tar.gz (6.9 kB view details)

Uploaded Source

Built Distribution

simple_pastebin_parser-0.5.2-py2.py3-none-any.whl (5.6 kB view details)

Uploaded Python 2 Python 3

File details

Details for the file simple_pastebin_parser-0.5.2.tar.gz.

File metadata

  • Download URL: simple_pastebin_parser-0.5.2.tar.gz
  • Upload date:
  • Size: 6.9 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.0.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.6.7

File hashes

Hashes for simple_pastebin_parser-0.5.2.tar.gz
Algorithm Hash digest
SHA256 bdf6d5ee88ae4fb6628e7fa731c6438a68ecd16edf5469087104119fd18efe48
MD5 42830d26bcc0791892eced80ae89a8bc
BLAKE2b-256 9a0d961b502de24957f2f092b416b758b95a838ea773cfaf93e7b478ec5f8d9f

See more details on using hashes here.

File details

Details for the file simple_pastebin_parser-0.5.2-py2.py3-none-any.whl.

File metadata

  • Download URL: simple_pastebin_parser-0.5.2-py2.py3-none-any.whl
  • Upload date:
  • Size: 5.6 kB
  • Tags: Python 2, Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.0.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.6.7

File hashes

Hashes for simple_pastebin_parser-0.5.2-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 50c386af37dc7863de32f25f8a28371400b791292f915bff479781e7d0ab819e
MD5 8765c7cfe354d8e86abc6a2fccb280fc
BLAKE2b-256 81c83eea7f8df786cbee907b507fc8a8a5a374106d8814dfdd97ab32248c1c13

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page