dbcls is a versatile client that supports various databases
Project description
DbCls
DbCls is a powerful database client that combines the functionality of a SQL editor and data visualization tool. It integrates the kaa editor for SQL query editing and the visidata tool for data representation, providing a seamless experience for database management and data analysis.
Features
- SQL query editing with syntax highlighting
- Direct query execution from the editor
- Data visualization with interactive tables
- Support for multiple database engines (MySQL, PostgreSQL, ClickHouse, SQLite)
- Configuration via command line or config file
- Table schema inspection
- Database and table browsing
- Query history and file-based query storage
Screenshots
SQL Editor
Data Visualization
Installation
pip install dbcls
Quick Start
Basic usage with command line arguments:
dbcls -H 127.0.0.1 -u user -p mypasswd -E mysql -d mydb mydb.sql
Command Line Options
| Option | Description |
|---|---|
-H, --host |
Database host address |
-u, --user |
Database username |
-p, --password |
Database password |
-E, --engine |
Database engine (mysql, postgres, clickhouse, sqlite3) |
-d, --dbname |
Database name |
-f, --filepath |
Database file path (SQLite only) |
-P, --port |
Port number (optional) |
-S, --unix-socket |
Path to Unix socket file (optional, overrides host/port) |
-c, --config |
Path to configuration file |
--no-compress |
Disable compression for ClickHouse connections |
--key-remap |
Remap key codes, e.g. "9:353,353:9" to swap Tab and Shift+Tab |
Configuration
Using a Config File
You can use a JSON configuration file instead of command line arguments:
dbcls -c config.json mydb.sql
Example config.json:
{
"host": "127.0.0.1",
"port": "3306",
"username": "user",
"password": "mypasswd",
"dbname": "mydb",
"engine": "mysql"
}
Using Bash Configuration
You can also provide configuration directly from a bash script:
#!/bin/bash
CONFIG='{
"host": "127.0.0.1",
"port": "3306",
"username": "user",
"password": "mypasswd",
"dbname": "mydb",
"engine": "mysql"
}'
dbcls -c <(echo "$CONFIG") mydb.sql
Editor Commands
Hotkeys
| Hotkey | Action |
|---|---|
Alt + 1 |
Show autocompletion suggestions |
Alt + r |
Execute query under cursor or selected text |
Alt + e |
Show database list with table submenu |
Alt + t |
Show tables list with schema and sample data options |
Ctrl + q |
Quit application |
Ctrl + s |
Save file |
Ctrl + h / F1 |
Show all available hotkeys |
LM-Powered Autocomplete
When dbcls/weights.json is present (see Model Training below),
autocomplete suggestions (Alt+1) are ranked by a trained language model that predicts
the most likely next SQL token given the current query context.
- Tables, columns, keywords, and functions are sorted by predicted relevance
- When the model expects a column name next, DbCls automatically loads columns from all tables referenced in the current query
- Degrades gracefully: if
weights.jsonis absent orsql_metadatais not installed, autocomplete falls back to alphabetical/prefix ranking
Navigation in Database and Table Listings
When using Alt + e (database list) or Alt + t (table list), you can navigate through the listings
Database List Navigation:
- Select a database and press
Enterto proceed to the table list for that database
Table List Navigation:
- Select a table and press
Enterto access options:- View table schema
- Show sample data
Data Visualization (visidata)
Hotkeys
| Hotkey | Action |
|---|---|
zf |
Format current cell (JSON indentation, number prettification) |
g+ |
Expand array vertically, similarly to how it's done in expand-col, but by creating new rows rather than columns |
E |
Edit the SQL query used to fetch sample data for the current table(in Alt + t page only) |
Exporting Data
DbCls supports exporting data from visidata in multiple formats:
SQL INSERT Export:
- After executing a query and viewing results in visidata, press either
Ctrl+Sto save orgYto copy to the clipboard - Enter filename with
.sqlextension (e.g.,output.sql) - The data will be saved as SQL INSERT statements
The SQL export uses the sheet name as the table name and includes all visible columns. Each row is exported as a separate INSERT statement.
For more visidata hotkeys, visit: https://www.visidata.org/man/
SQL Commands
| Command | Description |
|---|---|
.tables |
List all tables in current database |
.databases |
List all available databases |
.use <database> |
Switch to specified database |
.schema <table> |
Display schema for specified table |
Supported Database Engines
- MySQL
- PostgreSQL
- ClickHouse
- SQLite
Unix Socket Connections
DbCls supports connecting to MySQL and PostgreSQL via a Unix domain socket using the -S / --unix-socket option. When a socket path is provided, it takes precedence over --host and --port.
dbcls -S /tmp/mysql.sock -u user -d mydb -E mysql mydb.sql
Forwarding a Remote Unix Socket Over SSH
If the database server is remote and only accessible via Unix socket, you can forward the socket to your local machine using SSH local socket forwarding:
MySQL:
ssh -L /tmp/mysql.sock:/var/run/mysqld/mysqld.sock -N user@11.22.33.44
PostgreSQL:
ssh -L /tmp/pg.sock:/var/run/postgresql/.s.PGSQL.5432 -N user@11.22.33.44
Then connect using the forwarded local socket:
# MySQL
dbcls -S /tmp/mysql.sock -u user -d mydb -E mysql mydb.sql
# PostgreSQL
dbcls -S /tmp/pg.sock -u user -d mydb -E postgres mydb.sql
Note for PostgreSQL: DbCls automatically creates the required symlink (
.s.PGSQL.5432) in the system temp directory so that theaiopgdriver can locate the socket correctly. The symlink is recreated on each connection.
Wrapper Script with Auto SSH Tunnel
The script below automatically starts an SSH tunnel, runs dbcls, and kills the tunnel on exit:
MySQL (mysql_ssh.sh):
#!/bin/bash
REMOTE_USER=user
REMOTE_HOST=11.22.33.44
REMOTE_SOCKET=/var/run/mysqld/mysqld.sock
LOCAL_SOCKET=/tmp/dbcls_mysql_$$.sock
ssh -fNM -S /tmp/dbcls_ssh_ctl_$$ \
-L "$LOCAL_SOCKET:$REMOTE_SOCKET" \
"$REMOTE_USER@$REMOTE_HOST"
trap "ssh -S /tmp/dbcls_ssh_ctl_$$ -O exit $REMOTE_HOST 2>/dev/null; rm -f $LOCAL_SOCKET" EXIT
dbcls -S "$LOCAL_SOCKET" -u dbuser -d mydb -E mysql "$@"
PostgreSQL (pg_ssh.sh):
#!/bin/bash
REMOTE_USER=user
REMOTE_HOST=11.22.33.44
REMOTE_SOCKET=/var/run/postgresql/.s.PGSQL.5432
LOCAL_SOCKET=/tmp/dbcls_pg_$$.sock
ssh -fNM -S /tmp/dbcls_ssh_ctl_$$ \
-L "$LOCAL_SOCKET:$REMOTE_SOCKET" \
"$REMOTE_USER@$REMOTE_HOST"
trap "ssh -S /tmp/dbcls_ssh_ctl_$$ -O exit $REMOTE_HOST 2>/dev/null; rm -f $LOCAL_SOCKET" EXIT
dbcls -S "$LOCAL_SOCKET" -u dbuser -d mydb -E postgres "$@"
How it works:
ssh -fNM— starts SSH in background (-f) with a master control socket (-M) for easy cleanup-S /tmp/dbcls_ssh_ctl_$$— control socket path (unique per process via$$)trap ... EXIT— kills the SSH tunnel and removes the local socket file when the script exits for any reason"$@"— passes any extra arguments through to dbcls (e.g. a SQL file path)
Using a Config File with Unix Socket
You can also specify the socket path in a JSON config file:
{
"username": "user",
"password": "mypasswd",
"dbname": "mydb",
"engine": "mysql",
"unix_socket": "/tmp/mysql.sock"
}
Password safety
To ensure password safety, I recommend using the project ssh-crypt to encrypt your config file. This way, you can store your password securely and use it with dbcls.
Caveats:
- If you keep the raw password in a shell script, it will be visible to other users on the system.
- Even if you encrypt your password inside a shell script, if you pass it to dbcls via the command line, it will be visible in the process list.
To avoid this, you can use this technique:
#!/bin/bash
ENC_PASS='{V|B;*R$Ep:HtO~*;QAd?yR#b?V9~a34?!!sxqQT%{!x)bNby^5'
PASS_DEC=`ssh-crypt -d -s $PASS`
CONFIG=`cat << EOF
{
"host": "127.0.0.1",
"username": "user",
"password": "$PASS_DEC",
"dbname": "mydb",
"engine": "mysql"
}
`
dbcls -c <(echo "$CONFIG") mydb.sql
Model Training
DbCls ships with a train.py script for training or fine-tuning the language model
that powers LM-ranked autocomplete. The model is a small MLP trained on SQL corpora;
its weights are stored in dbcls/weights.json.
Training from scratch
python train.py train --corpus my_queries.sql
Fine-tuning an existing model
python train.py train --corpus my_queries.sql --finetune
python train.py train --corpus my_queries.sql --finetune --weights custom.json --output custom.json
Inspecting tokenization
Use --debug to print how each SQL statement is tokenized during training:
python train.py train --corpus my_queries.sql --debug
Running inference
python train.py infer --sql "SELECT * FROM"
python train.py infer --sql "SELECT id FROM users WHERE" --top-k 5
Options
| Option | Description |
|---|---|
--corpus FILE |
SQL file for training, one statement per line |
--finetune |
Load existing weights and continue training |
--weights FILE |
Weights file to load for fine-tuning (default: dbcls/weights.json) |
--output FILE |
Where to save trained weights (default: dbcls/weights.json) |
--epochs N |
Number of training epochs (default: 20) |
--lr FLOAT |
Learning rate (default: 0.01) |
--debug |
Print tokenization for each training sentence |
--sql TEXT |
(infer only) SQL prefix to complete |
--top-k N |
(infer only) Number of predictions to show (default: 10) |
Contributing
Contributions are welcome! Please feel free to submit a Pull Request or submit an issue on GitHub Issues
License
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file dbcls-1.2.4.tar.gz.
File metadata
- Download URL: dbcls-1.2.4.tar.gz
- Upload date:
- Size: 98.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.9.23
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
9291bdd10574b3f57a21a055ab4ef7f63f732d9500847975bb586ae08e4b8e92
|
|
| MD5 |
981a3ec069d633e6b7c303197fb9fdf8
|
|
| BLAKE2b-256 |
4912487e6159c423a3091a676ff10a15f661dc763138b56bd0662ab1d8435592
|
File details
Details for the file dbcls-1.2.4-py3-none-any.whl.
File metadata
- Download URL: dbcls-1.2.4-py3-none-any.whl
- Upload date:
- Size: 83.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/6.2.0 CPython/3.9.23
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
8d4f2a5db49290813ac631f9a940264c92afff64e8e60b844c8d8034bc48525f
|
|
| MD5 |
5634877595fa67ae65a5a6b442abbd05
|
|
| BLAKE2b-256 |
1101ef2f32476006724aac4a58bae8ff85fd3de496347ce008fdede94e569975
|