TextPinner 0.0.2

A python library for pinning a text to one of texts list. Useful for natural commands parsing.

TextPinner

A tool to pin text to a specific set of texts. Useful to build a tool that takes any text input then infer which one of the anchor texts is the best one.

Description

TextPinner pins text to a set of anchor texts. This is useful to build a natural language command module. ImagINE I have a robot. For example the InMoov robot can do a bunch of actions but you some how need to ask it to do something by saying exactly what you have already specified as possible inputs. But what if you can say the command how ever you like it, and the robot understands which one of the actions is the one you intended it to?

This code, uses Open-AI's Clip to encode both the text you say, and the list of anchor texts describing what the robot can do. Now we simply find the nearest anchor text encoding to the encoding of the text you said. Bingo, now you have anchored the text to waht the robot can do and you can say the command how ever you like it. The robot will understand.

Actually this works even when you tell the commands in another language (tryed it in French).

You can imagine doing this for a hue lighting system or other command based app. Be creative

Installation

To install TextPinner, you can use:

pip install TextPinner

Please install Open AI's Clip from their github repository. This is needed by TextPinner

pip install git+https://github.com/openai/CLIP.git

USE

First import TextPinner class

from TextPinner import TextPinner

Create an instance of TextPinner. There are one mandatory parameter which is the list of anchor text, and an optional parameter which is the maximum distance between the word and the anchors. This allows the AI to detect if the text the user is entering is too far from any of the anchors. By default the value is None (don't check for minimal distance). A value of 0.05 has proven to be a good distance for the tests we have done. Feel free to use another value :

tp = TextPinner(["raise right hand", "raise left hand", "nod", "shake hands", "look left", "look right"], maximum_distance=0.05)

Now you are ready to pin some text using process method that returns multiple useful outputs.

text_command = input("Input a text :")
output_text, index, probs, dists=tp.process(text_command)

• The index tells you which text of your anchors list is most lokely to have the same meaning as the text_command. If it is -1, this means that the meaning of the text is too far from any of the anchors. If maximum_distance is None then there is no maximum distance test and the AI will return the anchor with nearest meaning.

• output_text is literally the anchor text that has the nearest meaning to the one of text_command.

• probs is a list of probabilities of being the right anchor for each of the anchors.

• dists is a list of the distances between the command_text and each of the anchor texts.