Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Wayback Tweets

PyPI DOI Streamlit App Open In Collab

Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing (see Field Options), and saves the data in HTML, for easy viewing of the tweets using the iframe tags, CSV, and JSON formats.

Installation

pip install waybacktweets

Quickstart

Using Wayback Tweets as a standalone command line tool

waybacktweets [OPTIONS] USERNAME

waybacktweets --from 20150101 --to 20191231 --limit 250 jack

Using Wayback Tweets as a Web App

Open the application, a prototype written in Python with the Streamlit framework and hosted on Streamlit Cloud.

Using Wayback Tweets as a Python Module

from waybacktweets import WaybackTweets, TweetsParser, TweetsExporter

USERNAME = "jack"

api = WaybackTweets(USERNAME)
archived_tweets = api.get()

if archived_tweets:
    field_options = [
        "archived_timestamp",
        "original_tweet_url",
        "archived_tweet_url",
        "archived_statuscode",
    ]

    parser = TweetsParser(archived_tweets, USERNAME, field_options)
    parsed_tweets = parser.parse()

    exporter = TweetsExporter(parsed_tweets, USERNAME, field_options)
    exporter.save_to_csv()

Documentation

Acknowledgements

  • Tristan Lee (Bellingcat's Data Scientist) for the idea of the application.
  • Jessica Smith (Snowflake's Community Growth Specialist) and Streamlit/Snowflake team for the additional server resources on Streamlit Cloud.
  • OSINT Community for recommending the application.

Metadata

Release files for waybacktweets 1.0a7

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for waybacktweets 1.0a7
File Size Uploaded
waybacktweets-1.0a7.tar.gz 26.7 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for waybacktweets 1.0a7
File Interpreter ABI Platform
waybacktweets-1.0a7-py3-none-any.whl Python 3 none any Details

Total release size: 57.1 kB

Release files / waybacktweets-1.0a7.tar.gz

Download URL waybacktweets-1.0a7.tar.gz
Size 26.7 kB
Tags Source
SHA-256 checksum
How to use checksums
647e425fd2dc6bd67b8c9f074da7b1f9a0179c2e3f1cb3bb4a82be35eac229f1
BLAKE2b-256 checksum
How to use checksums
4e73f3fef334352ff094b123d3a8fe238ee3e11148ee9788838c0df23bb98277
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.11.5 Linux/5.15.153.1-microsoft-standard-WSL2

Release files / waybacktweets-1.0a7-py3-none-any.whl

Download URL waybacktweets-1.0a7-py3-none-any.whl
Size 30.5 kB
Tags Python 3
SHA-256 checksum
How to use checksums
7dbc8787e994516bcd7e70294c6fecfd0e56873e90ecebc67d1cadf38ed3464a
BLAKE2b-256 checksum
How to use checksums
c1ab828b1f4aa710c78f6ec55683fb780fa5f51b25fe9132c1fa4ef3e9999f45
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.11.5 Linux/5.15.153.1-microsoft-standard-WSL2
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page