plover-markdown-dictionary 0.2.0

Markdown literate dictionary support for Plover

Plover Markdown Dictionary

This is a markdown file with embedded code blocks, in the style of literate programming. Each code block contains a YAML-like bit of text defining your entries.

This project was borne out of a desire for a dictionary format with these features:

• easy to read and write by hand
• simple for non programmers
• allows comments
• editable (add/update/delete) through the Plover interface, without losing comments

Table of Contents

• Installation
  • Git version
  • Status
  • For development
• Format
  • Where to put your definitions
  • Definition Format
  • Comments
  • Repeat definitions
• GUI Behaviour
  • Adding
  • Deleting
  • Updating
• Converting to/from other formats
• Example
• Notes
  • Alternative dictionary formats
  • Performance
  • Why use (UPDATED) or (DELETED) tags?
  • Why this definition format?
  • Contributing

Installation

Install via the Plover plugin manager.

Git version

On the command-line (requires git):

plover -s plover_plugins install git+https://github.com/antistic/plover_markdown_dictionary.git

Status

This plugin is experimental and might have some bugs. Feel free to open an issue if you find one, and read the changelog when upgrading.

For development

git clone https://github.com/antistic/plover_markdown_dictionary
cd plover_markdown_dictionary
plover -s plover_plugins install -e .

Format

• It's a Markdown file, so you can do all the Markdown formatting you like!

Where to put your definitions

• Put your definitions in code blocks.

HRAOEUBG: like
TH: this

which in markdown looks

```
HRAOEUBG: like
TH: this
```

• You can set the syntax formatting language to YAML

Note: Although it looks like yaml, it isn't yaml.

TH/STEUL: this still
WORBGS: works

which in markdown looks like

```yaml
TH/STEUL: this still
WORBGS: works
```

• Code blocks defined as other formats will not be read as dictionary definitions. This makes it easy to comment out sections.

KOPLT/-D: commented
OUT: out

which looks like

```text
KOPLT/-D: commented
OUT: out
```

• Inline code blocks are will not be read as dictionary definitions.

• Code blocks defined by indentation (e.g. 4 spaces) will not be read as dictionary definitions.

Definition Format

• The basic format is STROKES: translation. Both the left and right side of the colon are treated as strings, even though they may not be in YAML.

#S: 1
2: 2
-T: the
*UR: you are
KWRE: yes

• You can quote these if you wish to preserve syntax formatting

'#S': '1'          # single quotes
'2': '2'
"-T": the           # double quotes
"*UR": you are
KWRE: "yes"

• There are some characters you will need to escape:

SKW-T: \' # single quote character
KR-GS: \" # double quote character
HAERB: \# # hash character on the right hand side
'#-T': 9 # you should not escape the # in strokes
PW-RB: \\ # backslash
R-R: \\n # newline
R*R: \\r # other newline
TAB: \\t # tab

• But you might prefer to use quotes:

SKW-T: "'"
KR-GS: '"'  # you can quote double quotes with single quotes
HAERB: '#'
PW-RB: "\\" # backslashes always need escaping, whether they're in quotes or not
R-R: "\\n" # same with newlines
R*R: "\\r"
TAB: "\\t" # and tabs
S-PS: ' ' # you'll need quotes for anything with starting or trailing spaces

Comments

You can use comments after entries. These must be on the same line, and they're denoted by a # symbol.

K-PLT: comment # this is a comment

Repeat definitions

You should avoid specifying the same stroke(s) multiple times. If you choose to do this anyway, you should assign the same translation every time. The plugin will make a best effort to update all rows of the same chord when Plover updates or deletes entries.

REPT: reptile  # this is overridden and ignored by Plover
REPT: repeat

REPT: repeat
REPT: repeat # it will only appear once in Plover, but we'll try to reflect changes everywhere

GUI Behaviour

NOTE: You shouldn't edit the file both in the Plover GUI and in your text editor at the same time, because it might lead to inconsistencies.
If you have edited the file manually, you can reload it in Plover by unchecking and rechecking the box next to the dictionary, or reloading with CTRL+R.

Adding

When you add an entry within the Plover interface, a section is created at the bottom of the file and entries are added. If the section already exists (defined by a heading with the text 'Added via Plover' then a single code block at the bottom of the file), it will add to that block.

Example of what you'll see at the bottom of the file:

## Added via Plover

```yaml
TPHU: new
SPWREUS: entries
TKPW: go
HAOER: here
```

Deleting

When you delete an entry, the line in the document is updated with a (DELETED) prefix and will be ignored when loading the dictionary in the future.

Example of deleting TKHRAOET/PHE: delete me

KP-PL: example
(DELETED) TKHRAOET/PHE: delete me # this is ignored by Plover
TEGT: text

Updating

When the translation is updated, the entry in the document is updated in place, and annotated with an (UPDATED) prefix for legibility; it is still read as normal by Plover.

Example of changing KP-L: example to KP-L: excel

KP-PL: example
(UPDATED) KP-L: excel
KPW-PL: example

When the stroke is updated it is treated like a deletion of the old entry then the addition of the new one.

Converting to/from other formats

1. In the dictionaries list, select the dictionaries you want to convert.
2. Right click, choose "Save dictionaries as...".
3. Choose whether you want to create a copy of each dictionary, or merge into a new one.
4. In the save file dialog, choose where to save the dictionary. To convert to JSON, save with the extension ".json". To convert to Markdown, save with the extension ".md".

Example

This file is an example! You can see the raw markdown here.

It is equivalent to example.json.

Notes

This format is a work in progress and I'd love to get feedback on what works or doesn't work for you!

Alternative dictionary formats

There are other plover dictionary formats that allow comments, but all of them have something that means they don't fit my original goals (as of June 2021).

format	comments
Excel	Dropped support for keeping comments on changing translations (in the form of other columns) in version 1.0.0
yaml	Does not support keeping comments, citing performance reasons. Yaml also has weird catches with strings, like needing "no" in quotes (otherwise parsed as boolean).
rtf/cre (built-in support, better-rtf)	The format is hard to read (personal opinion)
hjson	Does not support keeping comments on dictionary updates

Performance

Basic tests with the plover main dictionary using time.py on my laptop.

I haven't tried very hard to optimise this, so it's probably possible to go faster.

Test	Time
Load JSON	0.44s
Load JSON + Save JSON	1.15s
Load JSON + Save Markdown	1.52s
Load Markdown	1.48s
Load Markdown + Save Markdown	2.36s

Why use (UPDATED) or (DELETED) tags?

It's important that people know what's been changed so that they can make sure any description or comment stays up to date.

This could have been done via a version control system like git, but git requires a learning curve that non-programmers might not be comfortable with. Since people are likely to have to update the surrounding comments anyway, I thought it would not be too much work to remove the tags.

For those who are comfortable, you can always clone this repository, alter DELETED_PREFIX and UPDATED_PREFIX in ./plover_markdown_dictionary.py, and install your local version with plover -s plover_plugins install -e ..

Why this definition format?

json does not support comments. hjson (& other json extensions) and yaml are are not performant enough to be viable (according to the people making the dictionary plugins. I haven't tried).

This particular format was chosen to be easy to read and write. It looks very similar to the default json, but does not require quotes nor commas. One downside is that it's not easy to copy and paste between this format and the default json, but I haven't decided how important that is for the format yet.

I've also gone for an unstructured format for metadata (comments and Markdown) since other formats (e.g. JSON) are probably better structured metadata.

Contributing

If you have any questions or problems, feel free to open an issue! I'll also gladly take suggestions in the form of pull requests as well.