twarc2sql 0.2.2

This package converts jsonl file generated by twarc2 to sql database in an opnionated way.

twarc2sql

This package converts jsonl file generated by twarc2 to sql database in an opnionated way.

• Free software: MIT license

• Documentation: https://twarc2sql.readthedocs.io.

Features

• This package converts jsonl file generated by twarc2 to a postgres sql database in an opnionated way.

• It creates a database with multiple tables that can be found in the documentation & models.py file.

Installation

You can install twarc2sql using pip:

$ pip install twarc2sql

Usage

import twarc2sql

twarc2sql.connect_to_db_and_upload(
    "folderpath/to/jsonl/file",
    "jsonl_file",
    "twarc_task_type",
    "env_file_with_db_information",
)

Credits

This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.

History

0.1.0 (2023-03-23)

• First release on PyPI.