Skip to main content
Pre-release

This release is a pre-release and may not be stable for production use.

Wayback Tweets

PyPI docs Streamlit App

Retrieves archived tweets CDX data from the Wayback Machine, performs necessary parsing (see Field Options), and saves the data in CSV, JSON, and HTML formats.

Installation

pip install waybacktweets

Quickstart

Using Wayback Tweets as a standalone command line tool

waybacktweets [OPTIONS] USERNAME

waybacktweets --from 20150101 --to 20191231 --limit 250 jack

Using Wayback Tweets as a Python Module

from waybacktweets import WaybackTweets, TweetsParser, TweetsExporter

USERNAME = "jack"

api = WaybackTweets(USERNAME)
archived_tweets = api.get()

if archived_tweets:
    field_options = [
        "archived_timestamp",
        "original_tweet_url",
        "archived_tweet_url",
        "archived_statuscode",
    ]

    parser = TweetsParser(archived_tweets, USERNAME, field_options)
    parsed_tweets = parser.parse()

    exporter = TweetsExporter(parsed_tweets, USERNAME, field_options)
    exporter.save_to_csv()

Using Wayback Tweets as a Web App

Open the application, a prototype written in Python with the Streamlit framework and hosted on Streamlit Cloud.

Documentation

Acknowledgements

  • Tristan Lee (Bellingcat's Data Scientist) for the idea of the application.
  • Jessica Smith (Snowflake's Marketing Specialist) and Streamlit/Snowflake teams for the additional server resources on Streamlit Cloud.
  • OSINT Community for recommending the application.

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

waybacktweets-1.0a1.tar.gz (24.6 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

waybacktweets-1.0a1-py3-none-any.whl (28.3 kB view details)

Uploaded Python 3

File details

Details for the file waybacktweets-1.0a1.tar.gz.

File metadata

  • Download URL: waybacktweets-1.0a1.tar.gz
  • Upload date:
  • Size: 24.6 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.11.5 Linux/5.15.153.1-microsoft-standard-WSL2

File hashes

Hashes for waybacktweets-1.0a1.tar.gz
Algorithm Hash digest
SHA256 f1c8b0deee6223f21d1f90a016386a793c293489b5e14a8ab578a71c77e51654
MD5 fda9f6e85d3febcf334f4010f03cceab
BLAKE2b-256 f1e42b4887889454fc880e78771092a80b12d63436d15a70c384acf3bdf70645

See more details on using hashes here.

File details

Details for the file waybacktweets-1.0a1-py3-none-any.whl.

File metadata

  • Download URL: waybacktweets-1.0a1-py3-none-any.whl
  • Upload date:
  • Size: 28.3 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/1.8.3 CPython/3.11.5 Linux/5.15.153.1-microsoft-standard-WSL2

File hashes

Hashes for waybacktweets-1.0a1-py3-none-any.whl
Algorithm Hash digest
SHA256 43a96db81e2a9ad11d6bced7e51af7fed2ffaed49b0815d4f54fe0637f540c73
MD5 7fa12cb682783461d3f2e17749053f9f
BLAKE2b-256 a191bc1f28cdaf03096f446d5142c3699c250f276017045fac0cf0300a35e54d

See more details on using hashes here.

Release history Release notifications | RSS feed

1.0

2 files

This release

1.0a1 This release

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page