a small web crawler for the pastebin.com website
Project description
Simple-Pastebin-Parser
this is a simpler parser for the pastebin.com website.
it will iterate posts and parse their elements using lxml
installation:
pip install simple-pastebin-parser
example usage
import simple_pastebin_parser
for paste in simple_pastebin_parser.get_pastes():
print("Title: ", paste.Title)
print("Author: ", paste.Author)
print("date: ", paste.Date)
print("Content: ")
print(paste.Content)
print("*" * 20)
Release notes:
v0.1.0 - P.O.C
initial proof of concept. nothing special, just doing the dirty work of parsing the posts.
how to execute: 1. create a virtual env of python 3.6 2. install requirements 3. run python poc.py
v0.2.5 (2020-03-07)
integration with travis.ci
v0.2.6 (2020-03-07)
changing the POC code to work with installed pypi package
v0.3.0 (2020-03-07)
created the Paste() object for pastebin posts
ability to stream data
v0.3.3 (2020-03-07)
small fixes
v0.3.5 (2020-03-07)
update README
v0.4.0 (2020-03-08)
added documentation
cleaned most pep8 issues
some tests
v0.5.0 (2020-03-08)
parse date in UTC
add some logs
add id to Paste()
v0.5.2 (2020-03-09)
cleanups
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file simple_pastebin_parser-0.5.2.tar.gz
.
File metadata
- Download URL: simple_pastebin_parser-0.5.2.tar.gz
- Upload date:
- Size: 6.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.0.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.6.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | bdf6d5ee88ae4fb6628e7fa731c6438a68ecd16edf5469087104119fd18efe48 |
|
MD5 | 42830d26bcc0791892eced80ae89a8bc |
|
BLAKE2b-256 | 9a0d961b502de24957f2f092b416b758b95a838ea773cfaf93e7b478ec5f8d9f |
File details
Details for the file simple_pastebin_parser-0.5.2-py2.py3-none-any.whl
.
File metadata
- Download URL: simple_pastebin_parser-0.5.2-py2.py3-none-any.whl
- Upload date:
- Size: 5.6 kB
- Tags: Python 2, Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.0.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.6.7
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 50c386af37dc7863de32f25f8a28371400b791292f915bff479781e7d0ab819e |
|
MD5 | 8765c7cfe354d8e86abc6a2fccb280fc |
|
BLAKE2b-256 | 81c83eea7f8df786cbee907b507fc8a8a5a374106d8814dfdd97ab32248c1c13 |