Python script to take gab data (from Garc) and put it into a relational SQLite database
Project description
Gab tidy data tool
This is a little Python script to take Gab data output from Garc and ingest it into relational form in an SQLite database.
This tool is designed from an academic research viewpoint.
Usage instructions
Prerequisites
- Python 3.8+
- Git
This tool requires Python 3.8 or later, the instructions assume you already have Python installed. If you haven't installed Python before, you might find Python for Beginners helpful - note that Gab Tidy Data is a command line application, you don't need to write any Python code to use it (although you can if you want to), you just need to be able to run Python code!
The instructions assume sufficient familiarity with using a command line to change directories and execute commands. If you are new to the command line or want a refresher, there are some good lessons from Software Carpentry and the Programming Historian.
The instructions assume you are working in a suitable Python virtual environment. RealPython has a relatively straightforward primer on virtual environments if you are new to the concept. If you installed Python with Anaconda/conda, you will want to manage your virtual environments through Anaconda/conda as well.
Download and Installation
-
Ensure you are using an appropriate Python or Anaconda virtual environment
-
Install Gab Tidy Data and its requirements by running:
python -m pip install gab_tidy_data
-
Run the following to check that your environment is ready to run Gab Tidy Data:
gab_tidy_data --help
Usage
In your command line, ensuring you are using the Python or Anaconda virtual environment
you used to install Gab Tidy Data requirements, you can run the gab_tidy_data
command:
gab_tidy_data [data_file_1.jsonl] [data_file_2.jsonl] [database_name.db]
You may run the command with as many or as few JSON files (.json
or .jsonl
) as you
like, and they will all be loaded into the database specified. The database filename
must be the last argument provided to the gab_tidy_data
command.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
File details
Details for the file gab_tidy_data-0.1.0.tar.gz
.
File metadata
- Download URL: gab_tidy_data-0.1.0.tar.gz
- Upload date:
- Size: 22.1 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.11
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | f4bd5557bced5cc2bc2ad0812e29bfc54e871e38a83d1af0cc1f29b71f9c80ca |
|
MD5 | 204d7b3481ca171f739b8c7e30f35ae5 |
|
BLAKE2b-256 | f0ef401ea995c5b4a171e4a564b0f90b9593e52adc3fcbe3e3ffc32483c885e2 |
File details
Details for the file gab_tidy_data-0.1.0-py3-none-any.whl
.
File metadata
- Download URL: gab_tidy_data-0.1.0-py3-none-any.whl
- Upload date:
- Size: 14.2 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/3.4.2 importlib_metadata/4.8.1 pkginfo/1.7.1 requests/2.26.0 requests-toolbelt/0.9.1 tqdm/4.62.2 CPython/3.8.11
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | c9ff2e61c65101a963153c1a2f68f687f6ad38063d035952e648c5d2e2632346 |
|
MD5 | 5006852f08d0affa49dd8660c5601043 |
|
BLAKE2b-256 | 2138b0e2a9a726c830bdc88d49133b93f81468c90867dabd449027a08122821b |