Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Wayback Tweets

PyPI docs Streamlit App

Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing (see Field Options), and saves the data in CSV, JSON, and HTML formats.

Installation

pip install waybacktweets

Quickstart

Using Wayback Tweets as a standalone command line tool

waybacktweets [OPTIONS] USERNAME

waybacktweets --from 20150101 --to 20191231 --limit 250 jack

Using Wayback Tweets as a Python Module

from waybacktweets import WaybackTweets, TweetsParser, TweetsExporter

USERNAME = "jack"

api = WaybackTweets(USERNAME)
archived_tweets = api.get()

if archived_tweets:
    field_options = [
        "archived_timestamp",
        "original_tweet_url",
        "archived_tweet_url",
        "archived_statuscode",
    ]

    parser = TweetsParser(archived_tweets, USERNAME, field_options)
    parsed_tweets = parser.parse()

    exporter = TweetsExporter(parsed_tweets, USERNAME, field_options)
    exporter.save_to_csv()

Using Wayback Tweets as a Web App

Open the application, a prototype written in Python with the Streamlit framework and hosted on Streamlit Cloud.

Documentation

Acknowledgements

  • Tristan Lee (Bellingcat's Data Scientist) for the idea of the application.
  • Jessica Smith (Snowflake's Marketing Specialist) and Streamlit/Snowflake teams for the additional server resources on Streamlit Cloud.
  • OSINT Community for recommending the application.

[!NOTE] If the application is down, please check the Streamlit Cloud Status.

Metadata

Release files for waybacktweets 1.0a3

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for waybacktweets 1.0a3
File Size Uploaded
waybacktweets-1.0a3.tar.gz 26.0 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for waybacktweets 1.0a3
File Interpreter ABI Platform
waybacktweets-1.0a3-py3-none-any.whl Python 3 none any Details

Total release size: 55.7 kB

Release files / waybacktweets-1.0a3.tar.gz

Download URL waybacktweets-1.0a3.tar.gz
Size 26.0 kB
Tags Source
SHA-256 checksum
How to use checksums
7591a105156c7859423ef384df8d220c187f7fd348cd8fede205b77b6e3bb544
BLAKE2b-256 checksum
How to use checksums
8d039a54893808b2587ead33ba5a0ec32b18949a5aa95762b27473cbf9b11610
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.11.5 Linux/5.15.153.1-microsoft-standard-WSL2

Release files / waybacktweets-1.0a3-py3-none-any.whl

Download URL waybacktweets-1.0a3-py3-none-any.whl
Size 29.7 kB
Tags Python 3
SHA-256 checksum
How to use checksums
8b497cb369213890f0c61912635d9e31fb8c22fcb1d44f3e45e1cf730f3ca300
BLAKE2b-256 checksum
How to use checksums
d6742a740d4e95a4b1c456109f848a40f1c60b1a8a22d4059434a43fb2628662
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via poetry/1.8.3 CPython/3.11.5 Linux/5.15.153.1-microsoft-standard-WSL2
Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page