Skip to main content

Python script to take gab data (from Garc) and put it into a relational SQLite database

Project description

Gab tidy data tool

This is a little Python script to take Gab data output from Garc and ingest it into relational form in an SQLite database.

This tool is designed from an academic research viewpoint.

Usage instructions

Prerequisites

  • Python 3.8+
  • Git

This tool requires Python 3.8 or later, the instructions assume you already have Python installed. If you haven't installed Python before, you might find Python for Beginners helpful - note that Gab Tidy Data is a command line application, you don't need to write any Python code to use it (although you can if you want to), you just need to be able to run Python code!

The instructions assume sufficient familiarity with using a command line to change directories and execute commands. If you are new to the command line or want a refresher, there are some good lessons from Software Carpentry and the Programming Historian.

The instructions assume you are working in a suitable Python virtual environment. RealPython has a relatively straightforward primer on virtual environments if you are new to the concept. If you installed Python with Anaconda/conda, you will want to manage your virtual environments through Anaconda/conda as well.

Download and Installation

  1. Ensure you are using an appropriate Python or Anaconda virtual environment

  2. Install Gab Tidy Data and its requirements by running:

    python -m pip install gab_tidy_data

  3. Run the following to check that your environment is ready to run Gab Tidy Data:

    gab_tidy_data --help

Usage

In your command line, ensuring you are using the Python or Anaconda virtual environment you used to install Gab Tidy Data requirements, you can run the gab_tidy_data command:

gab_tidy_data [data_file_1.jsonl] [data_file_2.jsonl] [database_name.db]

You may run the command with as many or as few JSON files (.json or .jsonl) as you like, and they will all be loaded into the database specified. The database filename must be the last argument provided to the gab_tidy_data command.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

gab_tidy_data-0.1.0.tar.gz (22.1 kB view details)

Uploaded Source

Built Distribution

gab_tidy_data-0.1.0-py3-none-any.whl (14.2 kB view details)

Uploaded Python 3

File details

Details for the file gab_tidy_data-0.1.0.tar.gz.

File metadata

  • Download URL: gab_tidy_data-0.1.0.tar.gz
  • Upload date:
  • Size: 22.1 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.11

File hashes

Hashes for gab_tidy_data-0.1.0.tar.gz
Algorithm Hash digest
SHA256 f4bd5557bced5cc2bc2ad0812e29bfc54e871e38a83d1af0cc1f29b71f9c80ca
MD5 204d7b3481ca171f739b8c7e30f35ae5
BLAKE2b-256 f0ef401ea995c5b4a171e4a564b0f90b9593e52adc3fcbe3e3ffc32483c885e2

See more details on using hashes here.

File details

Details for the file gab_tidy_data-0.1.0-py3-none-any.whl.

File metadata

  • Download URL: gab_tidy_data-0.1.0-py3-none-any.whl
  • Upload date:
  • Size: 14.2 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.11

File hashes

Hashes for gab_tidy_data-0.1.0-py3-none-any.whl
Algorithm Hash digest
SHA256 c9ff2e61c65101a963153c1a2f68f687f6ad38063d035952e648c5d2e2632346
MD5 5006852f08d0affa49dd8660c5601043
BLAKE2b-256 2138b0e2a9a726c830bdc88d49133b93f81468c90867dabd449027a08122821b

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page