Skip to main content

FULL

Unsupervised evaluation of open-domain conversations using follow-ups likelihood.


Installation

pip install full

Example

We provide an example script using FULL which reproduces the results of the paper.

Open In Colab

Turn evaluation

from full import FULL
eval_model = FULL()
conversation = ["Hi", "What's your name"]
response = "None of your business"
evaluation = eval_model.evaluate_turn(convesation, response)
print(evaluation)

Conversation evaluation

from full import FULL
eval_model = FULL()
conversation = ["Hi", "What's your name", "None of your business"]
evaluation = eval_model.evaluate_turn(convesation)
print(evaluation)

License

full is distributed under the terms of the MIT license.

Metadata

Release files for full 0.0.3.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for full 0.0.3.1
File Size Uploaded
full-0.0.3.1.tar.gz 80.8 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for full 0.0.3.1
File Interpreter ABI Platform
full-0.0.3.1-py3-none-any.whl Python 3 none any Details

Total release size: 84.9 kB

Release files / full-0.0.3.1.tar.gz

Download URL full-0.0.3.1.tar.gz
Size 80.8 kB
Tags Source
SHA-256 checksum
How to use checksums
3923522acbcec49a7bdde4a9fb0a081e0f62ea010fc0408c2e1fa81bb9cff34f
BLAKE2b-256 checksum
How to use checksums
5c8f238c7f2168090eb8f24d45052cdad45789d1c109592c095b4b01f1b65f5b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via python-httpx/0.23.0

Release files / full-0.0.3.1-py3-none-any.whl

Download URL full-0.0.3.1-py3-none-any.whl
Size 4.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3c6fe68107303d180b1cd0e92e9d25701a78f4b14cf6767fc5c2bb2d7c5f8d95
BLAKE2b-256 checksum
How to use checksums
692bfe12d8c72fde7f4cfc731cf5e4bd7bd30cb6e2ce44b0e2e010e27e1958b5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via python-httpx/0.23.0

Release history Release notifications | RSS feed

This release

0.0.3.1 This release

2 release files

0.0.3

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page