Link Database Tools

Package provides tools that allow to filter databases produced by https://github.com/rumca-js/Django-link-archive.

Can filter or analyze entries from https://github.com/rumca-js/Internet-Places-Database.

Tools

  • DbAnalyzer - provides analysis of the DB contents
  • DbUpdate - modifies database. Can create missing tables, truncate tables.
  • Db2Feeds - converts database to DB of feeds
  • Db2JSON - converts database to JSON
  • JSON2Db - Converts JSON into datbase
  • DbMerge - Merges database with other databse
  • backup.sh - create backup of Postgres tables

DbAnalyzer

usage: dbanalyzer.py [-h] [--db DB] [--search SEARCH] [--order-by ORDER_BY] [--asc] [--desc]
                     [--table TABLE] [--title] [--votes] [--description] [--status] [--tags]
                     [--social] [--date-published] [--source] [--summary] [--columns] [--rss]
                     [--channel] [--json] [-i] [-v VERBOSITY]

Data analyzer program

options:
  -h, --help            show this help message and exit
  --db DB               DB to be scanned
  --search SEARCH       Search, with syntax same as the main program / site.
  --order-by ORDER_BY   order by column.
  --asc                 order ascending
  --desc                order descending
  --table TABLE         Table name
  --title               displays title
  --votes               displays votes
  --description         displays description
  --status              displays status
  --tags                displays tags
  --social              displays social data
  --date-published      displays date-published
  --source              displays source
  --summary             displays summary of tables
  --columns             displays summary of tables column names
  --rss                 displays RSS sources
  --channel             displays channels
  --json                JSON format
  -i, --ignore-case     Ignores case
  -v VERBOSITY, --verbosity VERBOSITY
                        Verbosity level

DbUpdate

usage: dbupdate.py [-h] [--db DB] [--create-tables] [--truncate-tables TRUNCATE_TABLES]
                   [--trunc-dynamic-data] [--trunc-configuration] [--trunc-search-data]
                   [--trunc-visits-data] [--delete-non-bookmarked] [--delete-no-votes]
                   [--delete-redundant] [--no-users] [--obfuscate] [-v VERBOSITY]

DB manipulation program

options:
  -h, --help            show this help message and exit
  --db DB               DB to be filtered
  --create-tables       Creates tables. Even missing ones
  --truncate-tables TRUNCATE_TABLES
                        Truncate table(s). Pass table names
  --trunc-dynamic-data  Truncates dynamic tables
  --trunc-configuration
                        Removes uneceesary configuration
  --trunc-search-data   Removes all search data
  --trunc-visits-data   Removes all visit data
  --delete-non-bookmarked
                        Removes non bookmarked
  --delete-no-votes     Removes entries without a vote
  --delete-redundant    Removes entries that are redundant - not bookmarked, no votes
  --no-users            Prepares for setup with no users
  --obfuscate           Obfuscates private data
  -v VERBOSITY, --verbosity VERBOSITY
                        Verbosity level

Db2Feeds

usage: db2feeds.py [-h] [--db DB] [--output-db OUTPUT_DB] [--update-rss] [--clean]
                   [--read-internet-links] [--output-format OUTPUT_FORMAT]
                   [--crawling-server CRAWLING_SERVER]

Data analyzer program

options:
  -h, --help            show this help message and exit
  --db DB               DB to be scanned
  --output-db OUTPUT_DB
                        File to be created
  --update-rss          Reads RSS to check it's title and properties
  --clean               If output db exists, then it is removed at start
  --read-internet-links
                        Reads entries to check if contains RSS. Without it only calculated RSS are
                        returned
  --output-format OUTPUT_FORMAT
                        format of display. LINES, JSON, SQLITE
  --crawling-server CRAWLING_SERVER
                        Remote crawling server

Db2JSON

usage: db2json.py [-h] [--db DB] [--output-dir OUTPUT_DIR] [--rows-max] [-f FORMAT] [-v VERBOSITY]

Data analyzer program

options:
  -h, --help            show this help message and exit
  --db DB               DB to be scanned
  --output-dir OUTPUT_DIR
                        Output directory
  --rows-max            Number of rows per file
  -f FORMAT, --format FORMAT
                        file name format
  -v VERBOSITY, --verbosity VERBOSITY
                        Verbosity level

DbMerge

usage: dbmerge.py [-h] [--input-dbs INPUT_DBS] [--output OUTPUT]

Data analyzer program

options:
  -h, --help            show this help message and exit
  --input-dbs INPUT_DBS
                        DBs to be scanned. Delim ,
  --output OUTPUT       DB to be produced

Utils

Reflected tools - provides access table definitions. Model - model data. Classes that allow you to modify, read tables

Installation

pip install linkarchivetools

Key dates

PyPI data
Data sourced directly from PyPI's database.
  • Released:
Newer release available (0.1.110)

1 maintainer

PyPI data
Data sourced directly from PyPI's database.
Avatar for renegat0x0 from gravatar.com renegat0x0

Credits

Author: Iwan Grozny

License

Other/Proprietary License (GPL3)

Requires

Python <4.0, >=3.10

Classifiers

Report project as malware

Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

linkarchivetools-0.1.107.tar.gz (58.8 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

linkarchivetools-0.1.107-py3-none-any.whl (71.4 kB view details)

Uploaded Python 3

File details

Details for the file linkarchivetools-0.1.107.tar.gz.

File metadata

  • Download URL: linkarchivetools-0.1.107.tar.gz
  • Upload date:
  • Size: 58.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.2 CPython/3.11.2 Linux/6.12.87+rpt-rpi-v8

File hashes

Hashes for linkarchivetools-0.1.107.tar.gz
Algorithm Hash digest
SHA256 cb8cdc8bd8b791bbdbc6b2c1f210b5892b84ca36931dbd7cadc11aa8980ff463
MD5 78ec917be32219583a210fc1b0adfcbe
BLAKE2b-256 f9edc3df7d34337fd8e41052a9e8341e7e79096885671d6258b82c63543a479c

See more details on using hashes here.

File details

Details for the file linkarchivetools-0.1.107-py3-none-any.whl.

File metadata

  • Download URL: linkarchivetools-0.1.107-py3-none-any.whl
  • Upload date:
  • Size: 71.4 kB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: poetry/2.1.2 CPython/3.11.2 Linux/6.12.87+rpt-rpi-v8

File hashes

Hashes for linkarchivetools-0.1.107-py3-none-any.whl
Algorithm Hash digest
SHA256 55f6a96ca6d396df3ebc9bbcf0be4e37f2ab85707ba6ce1807a41d746320c689
MD5 12d8d5b70854402a1ae6cab679cc9323
BLAKE2b-256 14b310e292ec7dc8d647fdd335cb9bcf04cca7d7bbd424dfedc1a9b8cec450e0

See more details on using hashes here.

Release history Release notifications | RSS feed

0.1.110

2 files

0.1.109

2 files

0.1.108

2 files

This release

0.1.107 This release

2 files

0.1.106

2 files

0.1.105

2 files

0.1.104

2 files

0.1.103

2 files

0.1.102

2 files

0.1.101

2 files

0.1.100

2 files

0.1.99

2 files

0.1.98

2 files

0.1.97

2 files

0.1.96

2 files

0.1.95

2 files

0.1.94

2 files

0.1.93

2 files

0.1.91

2 files

0.1.89

2 files

0.1.88

2 files

0.1.87

2 files

0.1.86

2 files

0.1.85

2 files

0.1.84

2 files

0.1.83

2 files

0.1.82

2 files

0.1.81

2 files

0.1.80

2 files

0.1.79

2 files

0.1.78

2 files

0.1.77

2 files

0.1.76

2 files

0.1.75

2 files

0.1.74

2 files

0.1.73

2 files

0.1.72

2 files

0.1.71

2 files

0.1.70

2 files

0.1.69

2 files

0.1.67

2 files

0.1.66

2 files

0.1.64

2 files

0.1.63

2 files

0.1.62

2 files

0.1.61

2 files

0.1.59

2 files

0.1.58

2 files

0.1.56

2 files

0.1.55

2 files

0.1.54

2 files

0.1.53

2 files

0.1.52

2 files

0.1.51

2 files

0.1.50

2 files

0.1.49

2 files

0.1.48

2 files

0.1.47

2 files

0.1.46

2 files

0.1.45

2 files

0.1.44

2 files

0.1.43

2 files

0.1.42

2 files

0.1.41

2 files

0.1.40

2 files

0.1.39

2 files

0.1.38

2 files

0.1.37

2 files

0.1.36

2 files

0.1.34

2 files

0.1.33

2 files

0.1.32

2 files

0.1.31

2 files

0.1.30

2 files

0.1.29

2 files

0.1.28

2 files

0.1.27

2 files

0.1.26

2 files

0.1.25

2 files

0.1.24

2 files

0.1.23

2 files

0.1.22

2 files

0.1.21

2 files

0.1.20

2 files

0.1.19

2 files

0.1.18

2 files

0.1.17

2 files

0.1.16

2 files

0.1.15

2 files

0.1.14

2 files

0.1.13

2 files

0.1.11

2 files

0.1.10

2 files

0.1.8

2 files

0.1.7

2 files

0.1.6

2 files

0.1.5

2 files

0.1.4

2 files

0.1.3

2 files

0.1.2

2 files

0.1.1

2 files

0.1.0

2 files

0.0.56

2 files

0.0.55

2 files

0.0.54

2 files

0.0.53

2 files

0.0.52

2 files

0.0.51

2 files

0.0.50

2 files

0.0.49

2 files

0.0.48

2 files

0.0.47

2 files

0.0.46

2 files

0.0.45

2 files

0.0.44

2 files

0.0.43

2 files

0.0.42

2 files

0.0.41

2 files

0.0.40

2 files

0.0.39

2 files

0.0.38

2 files

0.0.37

2 files

0.0.36

2 files

0.0.35

2 files

0.0.34

2 files

0.0.33

2 files

0.0.32

2 files

0.0.31

2 files

0.0.30

2 files

0.0.29

2 files

0.0.28

2 files

0.0.27

2 files

0.0.26

2 files

0.0.25

2 files

0.0.24

2 files

0.0.23

2 files

0.0.22

2 files

0.0.21

2 files

0.0.20

2 files

0.0.19

2 files

0.0.18

2 files

0.0.17

2 files

0.0.16

2 files

0.0.15

2 files

0.0.14

2 files

0.0.13

2 files

0.0.12

2 files

0.0.11

2 files

0.0.10

2 files

0.0.9

2 files

0.0.8

2 files

0.0.6

2 files

0.0.5

2 files

0.0.4

2 files

0.0.3

2 files

0.0.2

2 files

0.0.1

2 files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page