twarc2sql
This package converts jsonl file generated by twarc2 to sql database in an opnionated way.
Free software: MIT license
Documentation: https://twarc2sql.readthedocs.io.
Features
This package converts jsonl file generated by twarc2 to a postgres sql database in an opnionated way.
It creates a database with multiple tables that can be found in the documentation & models.py file.
Installation
You can install twarc2sql using pip:
$ pip install twarc2sqlUsage
import twarc2sql
twarc2sql.connect_to_db_and_upload(
"folderpath/to/jsonl/file",
"jsonl_file",
"twarc_task_type",
"env_file_with_db_information",
)Credits
This package was created with Cookiecutter and the audreyr/cookiecutter-pypackage project template.
History
0.1.0 (2023-03-23)
First release on PyPI.
1 maintainer
Metadata
1 maintainer
Release files for twarc2sql 1.0.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| twarc2sql-1.0.0.tar.gz | 487.3 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| twarc2sql-1.0.0-py2.py3-none-any.whl | Python 3, Python 2 | none | any | Details |
Total release size: 503.9 kB
Release files / twarc2sql-1.0.0.tar.gz
| Download URL | twarc2sql-1.0.0.tar.gz |
|---|---|
| Size | 487.3 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5d260e6d0c97e641b12de5bc49aaad767dab4ee55f0e97b68c03e13b9cd6441d
|
|
BLAKE2b-256 checksum How to use checksums |
21b86ddae0f40c5a6b5a2596807c8edd11125601c266dd134240e5ac6d0799d1
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.11.3
|
Release files / twarc2sql-1.0.0-py2.py3-none-any.whl
| Download URL | twarc2sql-1.0.0-py2.py3-none-any.whl |
|---|---|
| Size | 16.7 kB |
| Tags | Python 2 Python 3 |
|
SHA-256 checksum How to use checksums |
618d0dda70381539137362de75fe27edcf69eb6cd51e1007ec71936df4c80160
|
|
BLAKE2b-256 checksum How to use checksums |
56d3fa5e53207e2d30672fc016badb95f7575f3bd06291a55af74a310a3bb3ea
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.1 CPython/3.11.3
|
