4 projects
sampling-constraints
Library of incremental parsers used to force syntax constraints on next-token predictions during language model generation
scs-re
Modification of cpython `re` module in which patterns match any string that is a prefix of a matching string under its regex
weighted-levenshtein-substring
Library providing functions to calculate Levenshtein distance, Optimal String Alignment distance, and Damerau-Levenshtein distance, where the cost of each operation can be weighted by letter.
tacklebox
Improved handling of PyTorch module hooks