Link Database Tools
Package provides tools to manipulate awesome databases.
Provides awesome database specification
Example of awesome databases:
- https://github.com/rumca-js/Internet-Places-Database
- https://github.com/rumca-js/awesome-database-feeds
- https://github.com/rumca-js/awesome-database-top
Tools
- DbAnalyzer - provides analysis of the DB contents
- DbUpdate - modifies database. Can create missing tables, truncate tables.
- Db2Feeds - converts database to DB of feeds
- Db2JSON - converts database to JSON
- JSON2Db - Converts JSON into datbase
- DbMerge - Merges a database with other databse
- backup.py - create backup of Postgres tables
Installation
pip install linkarchivetools
Utils
Reflected tools - provides access table definitions. Model - model data. Classes that allow you to modify, read tables.
DbAnalyzer
usage: dbanalyzer.py [-h] [--db DB] [--search SEARCH] [--order-by ORDER_BY]
[--asc] [--desc] [--table TABLE] [--title] [--votes]
[--description] [--status] [--tags] [--social]
[--date-published] [--source] [--summary] [--columns]
[--rss] [--channel] [--json] [-i] [-v VERBOSITY]
Data analyzer program
options:
-h, --help show this help message and exit
--db DB DB to be scanned
--search SEARCH Search, with syntax same as the main program / site.
--order-by ORDER_BY order by column.
--asc order ascending
--desc order descending
--table TABLE Table name
--title displays title
--votes displays votes
--description displays description
--status displays status
--tags displays tags
--social displays social data
--date-published displays date-published
--source displays source
--summary displays summary of tables
--columns displays summary of tables column names
--rss displays RSS sources
--channel displays channels
--json JSON format
-i, --ignore-case Ignores case
-v VERBOSITY, --verbosity VERBOSITY
Verbosity level
DbUpdate
usage: dbupdate.py [-h] [--db DB] [--create-tables]
[--truncate-tables TRUNCATE_TABLES] [--trunc-dynamic-data]
[--trunc-configuration] [--trunc-search-data]
[--trunc-visits-data] [--delete-non-bookmarked]
[--delete-no-votes] [--delete-redundant] [--no-users]
[--obfuscate] [-v VERBOSITY]
DB manipulation program
options:
-h, --help show this help message and exit
--db DB DB to be filtered
--create-tables Creates tables. Even missing ones
--truncate-tables TRUNCATE_TABLES
Truncate table(s). Pass table names
--trunc-dynamic-data Truncates dynamic tables
--trunc-configuration
Removes uneceesary configuration
--trunc-search-data Removes all search data
--trunc-visits-data Removes all visit data
--delete-non-bookmarked
Removes non bookmarked
--delete-no-votes Removes entries without a vote
--delete-redundant Removes entries that are redundant - not bookmarked,
no votes
--no-users Prepares for setup with no users
--obfuscate Obfuscates private data
-v VERBOSITY, --verbosity VERBOSITY
Verbosity level
Db2Feeds
usage: db2feeds.py [-h] [--db DB] [--output-db OUTPUT_DB] [--update-rss]
[--clean] [--read-internet-links]
[--output-format OUTPUT_FORMAT]
[--crawling-server CRAWLING_SERVER]
Database links to feeds converter program
options:
-h, --help show this help message and exit
--db DB DB to be scanned
--output-db OUTPUT_DB
File to be created
--update-rss Reads RSS to check it's title and properties
--clean If output db exists, then it is removed at start
--read-internet-links
Reads entries to check if contains RSS. Without it
only calculated RSS are returned
--output-format OUTPUT_FORMAT
format of display. LINES, JSON, SQLITE
--crawling-server CRAWLING_SERVER
Remote crawling server
DbMerge
usage: dbmerge.py [-h] [--input-dbs INPUT_DBS] [--output OUTPUT]
Databases merge program
options:
-h, --help show this help message and exit
--input-dbs INPUT_DBS
DBs to be scanned. Delim ,
--output OUTPUT DB to be produced
Db2JSON
usage: db2json.py [-h] [--db DB] [--output-dir OUTPUT_DIR] [--rows-max]
[-f FORMAT] [-v VERBOSITY]
Database to JSON files converter
options:
-h, --help show this help message and exit
--db DB DB to be scanned
--output-dir OUTPUT_DIR
Output directory
--rows-max Number of rows per file
-f FORMAT, --format FORMAT
file name format
-v VERBOSITY, --verbosity VERBOSITY
Verbosity level
JSON2Db
usage: json2db.py [-h] [--input-file INPUT_FILE] [--input-dir INPUT_DIR]
[--output-db OUTPUT_DB] [--preserve-id]
[--vote-min VOTE_MIN] [--verbose]
Data converter program
options:
-h, --help show this help message and exit
--input-file INPUT_FILE
File to be scanned
--input-dir INPUT_DIR
Directory to be scanned
--output-db OUTPUT_DB
Output db name
--preserve-id Preserves ID of objects
--vote-min VOTE_MIN Minimum amount of entry vote
--verbose Shows more info
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
linkarchivetools-0.1.110.tar.gz
(59.3 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file linkarchivetools-0.1.110.tar.gz.
File metadata
- Download URL: linkarchivetools-0.1.110.tar.gz
- Upload date:
- Size: 59.3 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/2.1.2 CPython/3.11.2 Linux/6.12.87+rpt-rpi-v8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
6b7e02c99f0744c6fe23ccbaf094ed3ab3c3d0601571f8d2b047a3beb61f9194
|
|
| MD5 |
9e5506108528509013f359c244c34c41
|
|
| BLAKE2b-256 |
f3a75ee09ce7840922b6e5fadd02598782b05448616ab6f460becc4078779939
|
File details
Details for the file linkarchivetools-0.1.110-py3-none-any.whl.
File metadata
- Download URL: linkarchivetools-0.1.110-py3-none-any.whl
- Upload date:
- Size: 72.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
poetry/2.1.2 CPython/3.11.2 Linux/6.12.87+rpt-rpi-v8
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
b68f207df86269a7bab0a5b75932a97e9bbbeb57be574aa8b308cd173b1f0da5
|
|
| MD5 |
13e96bfc623dbf860438088bab6bba0a
|
|
| BLAKE2b-256 |
1e6356c73bc62b4e49eca0f36a1e3d1ef7a227e30adb994196276b40e39c6436
|