Skip to main content

Get phonetic spellings and syllable counts for any english word. Works with made up and non-dictionary words.

Project description

Big Phoney

Build Status License: GPL v3

Big Phoney is a python module that generates phonetic pronunciations from english words. For example, given the word "dinosaur", Big Phoney will return "D AY1 N AH0 S AO2 R". This is sometimes called "Grapheme-to-Phoneme Conversion" or G2P. Big Phoney works for any word, even those that don't appear in the dictionary and it's designed to handle special cases like currency and abbreviations.

Phonetic pronunciations are represented using the ARPAbet phoneme set.

Big Phoney can also count the number of syllables in any english word.

How it Works

When possible, pronunciations come from a dictionary which contains 134,000 words. Slang, proper-nouns, and made-up words that don't appear in the standard dictionary are predicted using a model. You can read more about the pronunciation prediction model on Kaggle.

Additionally, Big Phoney has a number of configurable preprocessors to handle cases where proper pronunciation requires special knowledge. For example "$5.00" is pronounced "F AY1 V D AA1 L ER0 Z". Currently, Big Phoney can handle: numbers, currency, times, symbols, abbreviations, email addresses, and urls.

Accuracy

For any of the 134,000 words found in the dictionary, you can expect 100% accurate pronunciations and syllable counts. For words not found in the dictionary, you can expect syllable counts to be accurate 98.1% of the time and pronunciations to be perfectly accurate 75.4% of the time. Even when a predicted pronunciation isn't completely correct, it's often very close.

Installation

Install with PyPI:

pip install big-phoney

Install from source:

git clone https://github.com/repp/big-phoney.git
cd big_phoney
python setup.py install

Usage

First, import Big Phoney:

from big_phoney import BigPhoney

Next, create an instance of the main class:

phoney = BigPhoney()

This will load the phonetic dictionary and prediction model into memory. It may take a second. It's in your best interest to not create multiple instances of this class.

Call phonize to generate phonetic spellings from words.

phoney.phonize('pterodactyl')  # --> 'T EH2 R OW0 D AE1 K T AH0 L'

# Works with multiple words. Individual pronunciations are seperate by 2 spaces:
phoney.phonize('tyrannosaurus rex')  # --> 'T IH0 R AE0 N AH0 S AO1 R AH0 S  R EH1 K S'

Call count_syllables to get the number of syllables in a word or phrase.

phoney.count_syllables('bird')  # --> 1
phoney.count_syllables('triceratops')  # --> 4

# Given multiple words, Big Phoney returns the total number of syllables:
phoney.count_syllables('welcome to jurassic park')  # --> 7

# If you want a list of syllable counts, try something like:
[phoney.count_syllables(word) for word in 'welcome to jurassic park'.split()]  # --> [2,1,3,1]

Preprocessors

Big Phoney has a number of default preprocessors designed to improve pronunciation results in special cases.

DEFAULT_PREPROCESSORS = [ExpandCurrencySymbols, FormatEmailAndURLs, ReplaceTimes,  SpacePadSymbols,
                             SpacePadNumbers, ReplaceAbbreviations, ReplaceNumbers]

By default all of the above preprocessors are applied. You can add and remove them when creating a Big Phoney instance with the preprocessors keyword argument:

phoney = BigPhoney(preprocessors=[ReplaceNumbers])  # Only preprocess numbers

To skip preprocessing entirely, just pass an empty list:

phoney = BigPhoney(preprocessors=[])  # No preprocessing

Be careful when adjusting the default preprocessors. Their order is important as some rely on other 'upstream' processors to be most effective.

To test a preprocessor setup, use the apply_preprocessors method:

phoney = BigPhoney()  # Use default preprocessors
phoney.apply_preprocessors('£7.89')  # --> 'seven pounds and eighty-nine pence'
phoney.apply_preprocessors('Mt St. Helens')  # --> 'mount saint helens'
phoney.apply_preprocessors('no_reply@gmail.com')  # --> 'no underscore reply at gmail dot com'
phoney.apply_preprocessors('1ft + 2ft = 3ft')  # --> 'one foot plus two feet equals three feet'
phoney.apply_preprocessors("It'll be 7:00am in 1,245.6 seconds")  # --> 'it'll be seven o'clock a m in one-thousand, two hundred and forty-five point six seconds'

Writing your own preprocessors is easy. Any class with a process method that inputs and outputs a single string is valid. For example:

class DummyPreprocessor:

    def process(self, input_string):
        # do some preprocessing here!
        return input_string

Other Options

As mentioned, Big Phoney uses a dictionary and a model to generate pronunciations, if you only want to use one or the other, you can create instances of each individually:

from big_phoney import PhoneticDictionary
phonetic_dict = PhoneticDictionary()
phonetic_dict.lookup('paleontologist')  # --> 'P EY2 L IY0 AH0 N T AA1 L AH0 JH IH0 S T' ✅
phonetic_dict.lookup('fakeosaur')  # --> None ❌
from big_phoney import PredictionModel
pred_model = PredictionModel()
pred_model.predict('paleontologist')  # --> 'P EY2 L IY0 AH0 N T AA1 L AH0 JH IH0 S T' ✅
phonetic_dict.lookup('fakeosaur')  # --> 'F EY1 K OW0 S AO2 R' ✅

The dictionary is faster and always correct but won't always return a result. The model is slower and less reliably accurate but it will always return something no matter what you throw at it. In most cases, you should just stick with the BigPhoney class.

Contributing

If you want to contribute to this project that's great! Make sure to check out dev/README.md for more info.

Acknowledgements

The dictionary and data used to train the phonetic prediction model came from the CMU Pronunciation Dictionary.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

big_phoney-1.0.1.tar.gz (16.7 kB view details)

Uploaded Source

Built Distribution

big_phoney-1.0.1-py3-none-any.whl (11.7 MB view details)

Uploaded Python 3

File details

Details for the file big_phoney-1.0.1.tar.gz.

File metadata

  • Download URL: big_phoney-1.0.1.tar.gz
  • Upload date:
  • Size: 16.7 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for big_phoney-1.0.1.tar.gz
Algorithm Hash digest
SHA256 bdd3e115ee1e0e75c6208f358fa05fbcd17414441e6eb8c6b96f2a63ec7a9049
MD5 2f138e36858f4ad891304e8403e297b0
BLAKE2b-256 2a9cf4074d6052eb3d62d74bb3009d77fe0742ad9e0d6cc0ac1e936b247d979e

See more details on using hashes here.

File details

Details for the file big_phoney-1.0.1-py3-none-any.whl.

File metadata

File hashes

Hashes for big_phoney-1.0.1-py3-none-any.whl
Algorithm Hash digest
SHA256 29b29ef69b909c75ef65bb5e724785737f80caf3143b6830fcbd591755a19b92
MD5 cb804cca96c60802029056b89fd646cd
BLAKE2b-256 1fef85d2640e11feff932c051199294f804fa390fdcb6c745d3e2a0da0d9e8d8

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page