Skip to main content

FULL

Unsupervised evaluation of open-domain conversations using follow-ups likelihood.


Installation

pip install full

Example

We provide an example script using FULL which reproduces the results of the paper.

Open In Colab

Turn evaluation

from full import FULL
eval_model = FULL()
conversation = ["Hi", "What's your name"]
response = "None of your business"
evaluation = eval_model.evaluate_turn(convesation, response)
print(evaluation)

Conversation evaluation

from full import FULL
eval_model = FULL()
conversation = ["Hi", "What's your name", "None of your business"]
evaluation = eval_model.evaluate_turn(convesation)
print(evaluation)

License

full is distributed under the terms of the MIT license.

Metadata

Release files for full 0.0.3.1

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for full 0.0.3.1
File Size Uploaded Provenance Actions
full-0.0.3.1.tar.gz 80.8 kB Without provenance Details for full-0.0.3.1.tar.gz

Built distribution (wheel)

Table of built distributions (wheels) for full 0.0.3.1
File Interpreter ABI Platform Actions
full-0.0.3.1-py3-none-any.whl Python 3 none any Details for full-0.0.3.1-py3-none-any.whl

Total release size: 84.9 kB

Release files / full-0.0.3.1.tar.gz

Download URL full-0.0.3.1.tar.gz
Size 80.8 kB
Tags Source
SHA-256 checksum
How to use checksums
3923522acbcec49a7bdde4a9fb0a081e0f62ea010fc0408c2e1fa81bb9cff34f
BLAKE2b-256 checksum
How to use checksums
5c8f238c7f2168090eb8f24d45052cdad45789d1c109592c095b4b01f1b65f5b
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via python-httpx/0.23.0

Release files / full-0.0.3.1-py3-none-any.whl

Download URL full-0.0.3.1-py3-none-any.whl
Size 4.1 kB
Tags Python 3
SHA-256 checksum
How to use checksums
3c6fe68107303d180b1cd0e92e9d25701a78f4b14cf6767fc5c2bb2d7c5f8d95
BLAKE2b-256 checksum
How to use checksums
692bfe12d8c72fde7f4cfc731cf5e4bd7bd30cb6e2ce44b0e2e010e27e1958b5
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via python-httpx/0.23.0

Security for full 0.0.3.1

Provenance

Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.

No provenance found

None of the files in this release were uploaded with provenance metadata.

A note on package security

PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.

To learn more about protecting yourself from malicious actors, visit our package security documentation.

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page