languagemodels 0.0.4

Simple inference for large language models

Language Models

A Python package providing simple building blocks for exploring natural language processing.

Installation

This package can be installed using the following command:

pip install languagemodels

Example Usage

Here are some usage examples as Python REPL sessions. This should work in the REPL, notebooks, or in traditional scripts and applications.

Text Completions

>>> import languagemodels as lm

>>> lm.complete("She hid in her room until")
'she was sure she was safe'

Instruction Following

>>> import languagemodels as lm

>>> lm.do("Translate to English: Hola, mundo!")
'Hello, world!'

>>> lm.do("What is the capital of France?")
'paris'

Classification

>>> import languagemodels as lm

>>> lm.classify("Language models are useful", "positive", "negative")
'positive'

Semantic Search

>>> import languagemodels as lm

>>> lm.store_doc("Mars is a planet")
>>> lm.store_doc("The sun is hot")
>>> lm.load_doc("What is Mars?")
'Mars is a planet'

Extractive Question Answering

>>> import languagemodels as lm

>>> lm.extract_answer("What color is the ball?", "There is a green ball and a red box")
'green'

External Retrieval

>>> import languagemodels as lm

>>> lm.fetch_wiki('Chemistry')
'Chemistry is the scientific study...

>>> lm.fetch_weather(41.8, -87.6)
'Partly cloudy with a chance of rain...

Misc Text Tools

>>> import languagemodels as lm

>>> get_date()
'Friday, May 12, 2023 at 09:27AM'

Full documentation

Projects

This package can be used to do the heavy lifting for a number of learning projects:

• Basic chatbot
• Chatbot with information retrieval
• Chatbot with access to real-time information
• Text classification
• Extractive question answering
• Semantic search
• Document question answering