Link Database Tools
Package provides tools to manipulate awesome databases.
Provides awesome database specification
Example of awesome databases:
- https://github.com/rumca-js/Internet-Places-Database
- https://github.com/rumca-js/awesome-database-feeds
- https://github.com/rumca-js/awesome-database-top
Tools
- DbAnalyzer - provides analysis of the DB contents
- DbUpdate - modifies database. Can create missing tables, truncate tables.
- Db2Feeds - converts database to DB of feeds
- Db2JSON - converts database to JSON
- JSON2Db - Converts JSON into datbase
- DbMerge - Merges a database with other databse
- backup.py - create backup of Postgres tables
Installation
pip install linkarchivetools
Utils
Reflected tools - provides access table definitions. Model - model data. Classes that allow you to modify, read tables.
DbAnalyzer
usage: dbanalyzer.py [-h] [--db DB] [--search SEARCH] [--order-by ORDER_BY]
[--asc] [--desc] [--table TABLE] [--title] [--votes]
[--description] [--status] [--tags] [--social]
[--date-published] [--source] [--summary] [--columns]
[--rss] [--channel] [--json] [-i] [-v VERBOSITY]
Data analyzer program
options:
-h, --help show this help message and exit
--db DB DB to be scanned
--search SEARCH Search, with syntax same as the main program / site.
--order-by ORDER_BY order by column.
--asc order ascending
--desc order descending
--table TABLE Table name
--title displays title
--votes displays votes
--description displays description
--status displays status
--tags displays tags
--social displays social data
--date-published displays date-published
--source displays source
--summary displays summary of tables
--columns displays summary of tables column names
--rss displays RSS sources
--channel displays channels
--json JSON format
-i, --ignore-case Ignores case
-v VERBOSITY, --verbosity VERBOSITY
Verbosity level
DbUpdate
usage: dbupdate.py [-h] [--db DB] [--create-tables]
[--truncate-tables TRUNCATE_TABLES] [--trunc-dynamic-data]
[--trunc-configuration] [--trunc-search-data]
[--trunc-visits-data] [--delete-non-bookmarked]
[--delete-no-votes] [--delete-redundant] [--no-users]
[--obfuscate] [-v VERBOSITY]
DB manipulation program
options:
-h, --help show this help message and exit
--db DB DB to be filtered
--create-tables Creates tables. Even missing ones
--truncate-tables TRUNCATE_TABLES
Truncate table(s). Pass table names
--trunc-dynamic-data Truncates dynamic tables
--trunc-configuration
Removes uneceesary configuration
--trunc-search-data Removes all search data
--trunc-visits-data Removes all visit data
--delete-non-bookmarked
Removes non bookmarked
--delete-no-votes Removes entries without a vote
--delete-redundant Removes entries that are redundant - not bookmarked,
no votes
--no-users Prepares for setup with no users
--obfuscate Obfuscates private data
-v VERBOSITY, --verbosity VERBOSITY
Verbosity level
Db2Feeds
usage: db2feeds.py [-h] [--db DB] [--output-db OUTPUT_DB] [--update-rss]
[--clean] [--read-internet-links]
[--output-format OUTPUT_FORMAT]
[--crawling-server CRAWLING_SERVER]
Database links to feeds converter program
options:
-h, --help show this help message and exit
--db DB DB to be scanned
--output-db OUTPUT_DB
File to be created
--update-rss Reads RSS to check it's title and properties
--clean If output db exists, then it is removed at start
--read-internet-links
Reads entries to check if contains RSS. Without it
only calculated RSS are returned
--output-format OUTPUT_FORMAT
format of display. LINES, JSON, SQLITE
--crawling-server CRAWLING_SERVER
Remote crawling server
DbMerge
usage: dbmerge.py [-h] [--input-dbs INPUT_DBS] [--output OUTPUT]
Databases merge program
options:
-h, --help show this help message and exit
--input-dbs INPUT_DBS
DBs to be scanned. Delim ,
--output OUTPUT DB to be produced
Db2JSON
usage: db2json.py [-h] [--db DB] [--output-dir OUTPUT_DIR] [--rows-max]
[-f FORMAT] [-v VERBOSITY]
Database to JSON files converter
options:
-h, --help show this help message and exit
--db DB DB to be scanned
--output-dir OUTPUT_DIR
Output directory
--rows-max Number of rows per file
-f FORMAT, --format FORMAT
file name format
-v VERBOSITY, --verbosity VERBOSITY
Verbosity level
JSON2Db
usage: json2db.py [-h] [--input-file INPUT_FILE] [--input-dir INPUT_DIR]
[--output-db OUTPUT_DB] [--preserve-id]
[--vote-min VOTE_MIN] [--verbose]
Data converter program
options:
-h, --help show this help message and exit
--input-file INPUT_FILE
File to be scanned
--input-dir INPUT_DIR
Directory to be scanned
--output-db OUTPUT_DB
Output db name
--preserve-id Preserves ID of objects
--vote-min VOTE_MIN Minimum amount of entry vote
--verbose Shows more info
1 maintainer
Metadata
1 maintainer
Release files for linkarchivetools 1.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| linkarchivetools-1.1.0.tar.gz | 65.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| linkarchivetools-1.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 144.3 kB
Release files / linkarchivetools-1.1.0.tar.gz
| Download URL | linkarchivetools-1.1.0.tar.gz |
|---|---|
| Size | 65.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
701a8828c5d6af9c92b7133f35ec4a776fe846923d7d9deb85d8c0cd33d84234
|
|
BLAKE2b-256 checksum How to use checksums |
1ee61b5bbca030c72b3787b8b055e270669bb83295c94e3ff17be8cda5e2f453
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.1.2 CPython/3.11.2 Linux/6.12.87+rpt-rpi-v8
|
Release files / linkarchivetools-1.1.0-py3-none-any.whl
| Download URL | linkarchivetools-1.1.0-py3-none-any.whl |
|---|---|
| Size | 79.2 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
366e1eb4da1a5872e98b1bf7af9387f0b522ba446847c7a00ff9c66d5a0fc5a7
|
|
BLAKE2b-256 checksum How to use checksums |
f725523349312fc3a3385aa36a33812017a6e71189fa504e6efba65e68afd0e9
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
poetry/2.1.2 CPython/3.11.2 Linux/6.12.87+rpt-rpi-v8
|
