a speech recognition system structured based on an acoustic and a language model
Project description
Speech Recognition wave2words
This package is a test sample and contains two functions and acts as a single program:
a pronunciation/rhythm/stress words-phrases game (English). The package could be customized for
a speech-to-text system by accepting input from a microphone or an audio file or both. The
package could be structured for any language of choice.
In this package, we will test our wave2word speech recognition using AI, for English. However,
in the future releases, other languages will be added to make a language-independent speech
recognition.
Concept
We may guess a word from unknown spoken languages just by listening to the sound of the Speech.
To us, in an interaction between a human and a machine, the machine should recognise sounds before
making sense of any words (built from the combination of sounds) meaning. In other words,
without pre-determining the language a speech recognition should pick up sounds and form words.
Our speech processing system focuses on the process of understanding the acoustic features of
sounds, then building words that are spoken by human beings. The speech signals are captured with
the help of a microphone and then they are to be understood by the system.
The difficulty of speech recognition technology can be broadly characterised along some
dimensions such as 1)size of a specific language vocabulary pool, 2)speaker dependency-sounds of
a particular word vary from a person to another, 3) the importance of channel quality; human speech
contains high bandwidth with full frequency range, while a telephone speech consists of low
bandwidth with limited frequency range, 4)speaking mode that is whether the speech is in isolated
word mode, or connected word mode, or in a continuous speech mode. A continuous speech is
harder to recognize, 5)speaking style; a loud-read speech, spontaneous and conversational, 6) type
of the noise − signal to noise ratio may be in various ranges, depending on the acoustic environment
that observes less versus more background noise, 7) microphone quality and the distance between mouth
and microphone.
Recording and Sampling
During recording with a microphone, the signals are stored in a digitised form. But to work upon it,
the machine needs them in the discrete numeric form. Hence, our algorithm should sample the signals
at a particular frequency and convert the signal into the discrete numerical form. Choosing the high
frequency for sampling implies that when humans listen to the signal, they feel it as a continuous
audio signal.
Transforming to Frequency Domain
Characterising an audio signal involves converting the time domain signal into the frequency domain,
and understanding its frequency components that is an essential step because it gives a lot of information
about the signal. You can use a mathematical tool like Fourier Transform to perform this transformation.
This transformation is the most critical step in building a speech recogniser because after converting the
speech signal into the frequency domain, we must convert it into the usable form of the feature vector.
We can use different feature extraction techniques like MFCC, PLP, PLP-RASTA etc. for this purpose.
Myvoicerecognition is unique in its aim to provide a complete quantitative and analytical way to study the acoustic
features of a speech. Moreover, those features could be analysed further by employing Python's functionality
to provide more fascinating insights into speech patterns.
This library is for Linguists, scientists, developers, speech and language therapy clinics and researchers.
Please note that Myvoicerecognition Analysis is currently in the initial state though in active development. While
the amount of functionality that is now present is not huge; more will be added over the next few months.
=============
Installation
=============
Myvoicerecognition can be installed like any other Python library, using (a recent version of) the Python package
manager pip, on Linux, macOS, and Windows:
------------- pip install Myvoicerecognition ------------------------------
or, to update your installed version to the latest release:
------------- pip install -u Myvoicerecognition ---------------------------------
NOTE:
You need to get the following packages installed:
-----the Microsoft Visual C++ Redistributable for Visual Studio 2017 ------x86 or x64-----see your system
-----PyAudio---PyAudio>= 0.2.11---pip install PyAudio (win),
----------------------------------$ sudo apt-get install python-pyaudio python3-pyaudio (Debian-based Linux
----------------------------------$ brew install portaudio ----$ pip install pyaudio (MaC)
-----PyAudio-0.2.11-cp37-cp37m-win32.whl or win64.whl -----if your system throws an error for PyAudio
you may get the third file from
---------- https://github.com/Shahabks/Myvoicerecognition------
save it in a directory and in cmd (command line).../directory/ pip install PyAudio-0.2.11-cp37-cp37m-winxx.whl.
The package uses the default system microphone. If your system has no default microphone, or you want to use
a microphone other than the default, you will need to specify which one to use by supplying a device index.
To check how the Myvoicerecognition functions behave, please check
---------------- EXAMPLES.docx on --------
------------- https://github.com/Shahabks/Myvoicerecognition-----
Myvoicerecognition was developed by MYOLUTIONS Lab in Japan. It is part of New Generation of Voice
Recognition and Acoustic & Language modeling Project in MYSOLUTIONS Lab. That is planned to enrich
the functionality of Myvoicerecognition by adding more advanced functions.
This package is a test sample and contains two functions and acts as a single program:
a pronunciation/rhythm/stress words-phrases game (English). The package could be customized for
a speech-to-text system by accepting input from a microphone or an audio file or both. The
package could be structured for any language of choice.
In this package, we will test our wave2word speech recognition using AI, for English. However,
in the future releases, other languages will be added to make a language-independent speech
recognition.
Concept
We may guess a word from unknown spoken languages just by listening to the sound of the Speech.
To us, in an interaction between a human and a machine, the machine should recognise sounds before
making sense of any words (built from the combination of sounds) meaning. In other words,
without pre-determining the language a speech recognition should pick up sounds and form words.
Our speech processing system focuses on the process of understanding the acoustic features of
sounds, then building words that are spoken by human beings. The speech signals are captured with
the help of a microphone and then they are to be understood by the system.
The difficulty of speech recognition technology can be broadly characterised along some
dimensions such as 1)size of a specific language vocabulary pool, 2)speaker dependency-sounds of
a particular word vary from a person to another, 3) the importance of channel quality; human speech
contains high bandwidth with full frequency range, while a telephone speech consists of low
bandwidth with limited frequency range, 4)speaking mode that is whether the speech is in isolated
word mode, or connected word mode, or in a continuous speech mode. A continuous speech is
harder to recognize, 5)speaking style; a loud-read speech, spontaneous and conversational, 6) type
of the noise − signal to noise ratio may be in various ranges, depending on the acoustic environment
that observes less versus more background noise, 7) microphone quality and the distance between mouth
and microphone.
Recording and Sampling
During recording with a microphone, the signals are stored in a digitised form. But to work upon it,
the machine needs them in the discrete numeric form. Hence, our algorithm should sample the signals
at a particular frequency and convert the signal into the discrete numerical form. Choosing the high
frequency for sampling implies that when humans listen to the signal, they feel it as a continuous
audio signal.
Transforming to Frequency Domain
Characterising an audio signal involves converting the time domain signal into the frequency domain,
and understanding its frequency components that is an essential step because it gives a lot of information
about the signal. You can use a mathematical tool like Fourier Transform to perform this transformation.
This transformation is the most critical step in building a speech recogniser because after converting the
speech signal into the frequency domain, we must convert it into the usable form of the feature vector.
We can use different feature extraction techniques like MFCC, PLP, PLP-RASTA etc. for this purpose.
Myvoicerecognition is unique in its aim to provide a complete quantitative and analytical way to study the acoustic
features of a speech. Moreover, those features could be analysed further by employing Python's functionality
to provide more fascinating insights into speech patterns.
This library is for Linguists, scientists, developers, speech and language therapy clinics and researchers.
Please note that Myvoicerecognition Analysis is currently in the initial state though in active development. While
the amount of functionality that is now present is not huge; more will be added over the next few months.
=============
Installation
=============
Myvoicerecognition can be installed like any other Python library, using (a recent version of) the Python package
manager pip, on Linux, macOS, and Windows:
------------- pip install Myvoicerecognition ------------------------------
or, to update your installed version to the latest release:
------------- pip install -u Myvoicerecognition ---------------------------------
NOTE:
You need to get the following packages installed:
-----the Microsoft Visual C++ Redistributable for Visual Studio 2017 ------x86 or x64-----see your system
-----PyAudio---PyAudio>= 0.2.11---pip install PyAudio (win),
----------------------------------$ sudo apt-get install python-pyaudio python3-pyaudio (Debian-based Linux
----------------------------------$ brew install portaudio ----$ pip install pyaudio (MaC)
-----PyAudio-0.2.11-cp37-cp37m-win32.whl or win64.whl -----if your system throws an error for PyAudio
you may get the third file from
---------- https://github.com/Shahabks/Myvoicerecognition------
save it in a directory and in cmd (command line).../directory/ pip install PyAudio-0.2.11-cp37-cp37m-winxx.whl.
The package uses the default system microphone. If your system has no default microphone, or you want to use
a microphone other than the default, you will need to specify which one to use by supplying a device index.
To check how the Myvoicerecognition functions behave, please check
---------------- EXAMPLES.docx on --------
------------- https://github.com/Shahabks/Myvoicerecognition-----
Myvoicerecognition was developed by MYOLUTIONS Lab in Japan. It is part of New Generation of Voice
Recognition and Acoustic & Language modeling Project in MYSOLUTIONS Lab. That is planned to enrich
the functionality of Myvoicerecognition by adding more advanced functions.
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Myvoicerecognition-1.tar.gz
(5.8 kB
view details)
Built Distribution
File details
Details for the file Myvoicerecognition-1.tar.gz
.
File metadata
- Download URL: Myvoicerecognition-1.tar.gz
- Upload date:
- Size: 5.8 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.20.1 setuptools/40.6.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 2c95ebca096d7fd6e50d85f755e345dd11716620f0602c1c71949bb3fe2cca85 |
|
MD5 | 12a8c55e93be08647890fd1b1ca0d731 |
|
BLAKE2b-256 | 0ab636fb4782508dcfd0912964edf39f542b5302ccb64cb07dc43a8aac452dfc |
File details
Details for the file Myvoicerecognition-1-py3-none-any.whl
.
File metadata
- Download URL: Myvoicerecognition-1-py3-none-any.whl
- Upload date:
- Size: 29.8 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via: twine/1.12.1 pkginfo/1.4.2 requests/2.20.1 setuptools/40.6.3 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.7.0
File hashes
Algorithm | Hash digest | |
---|---|---|
SHA256 | 0eee45abd766b713b9beafd9e210e8b8ff6d62395e19037fad7af99f7b660fa0 |
|
MD5 | 2aed22ff85884bf06b05afb809840e18 |
|
BLAKE2b-256 | a3b5ae8a12630bf501d52ab1c29d458e1f737965da6f68ef5f45ee381d7ca248 |