Skip to main content

air-piano

Project description

air_calculator

Writing letters with a pen on paper is very different from drawing letters in the air.

Drawing "-" minus operator and "+" operator in the air are extremely difficult so that these operators in the current system are replaced by "W" and "P" respectively.

When drawing letters with fingers in the air, letters that are difficult to recognize or write in the air need to be replaced with letters that can be accurately recognized by artificial intelligence. For example, replace the number "1" with "L" in the air.

How to install necessary libraries

$ pip install pytesseract

For Windows users, you should also install the latest tesseract

https://github.com/UB-Mannheim/tesseract/wiki

And add tesseract.exe of Tesseract-OCR directory PATH in .profile or .bashrc.

How to run fingermath.py

fingermath.py is a program for drawing an expression, for example, 4-5.

fingermath.py is based on mediapipe.

There are six states of five fingers recognized by mediapipe library: 0-finger, 1-finger, 2-finger, 3-finger, 4-finger, and 5-finger respectively.

A pen of index finger tip is used for drawing an expression 
by fingers. 

0-finger can move the pen without drawing. 
1-finger can draw lines in the air. 
2-finger can move the pen without drawing. 
3-finger can delete elements of drawn letters for expression 
correction.
4-finger can transform hand-written letters to the digital text 
for possible calculation.
5-finger can can move the pen without drawing. 

Continuous 4-finger state can terminate and exit this program.

0-finger or 5-finger is equivalent to 2-finger.

The saved picture is tranformed into digital text using the state-of-the-art optical character recognition.

Writing letters with a pen on paper is very different from drawing letters in the air.

Of the 0 to 9 digits, 1 is the least recognizable number.

Drawing "L" in the air represents "1".

"S" or "5" in the air represents "5".

"P" in the air represents "+" plus operator.

"W" or "-" represents "-" minus operator.

"V" in the air represents "/" division operator.

"M" in the air represents "*" multiplication operator.

"&" in the air represents "**" exponential operator.

Drawing two letters "a" and "A" in the air represents the sqrt() function. Therefore, the string "a13A" or "aL3A" represents sqrt(13).

$ python fingermath.py

https://youtu.be/med_jrFTMPA

  sqrt(6)*2=?    
         1-3=?                                 10+2=?  

        4-5-3=?                                2-3/5=?   

        34*5=?                         2**8=?

      2&9V3 --> 2**9/3                          2**9/3      

 128v3=? -> 128/3=?                    a11AV3=? -> sqrt(11)/3 

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

aircalc-0.0.1.tar.gz (2.7 kB view hashes)

Uploaded Source

Built Distributions

aircalc-0.0.1-py3.7.egg (2.4 kB view hashes)

Uploaded Source

aircalc-0.0.1-py3-none-any.whl (2.6 kB view hashes)

Uploaded Python 3

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page