Statcan Dialogue Dataset
| 💻Code | 📄Paper | 🌐Homepage |
|---|
The StatCan Dialogue Dataset: Retrieving Data Tables through Conversations with Genuine Intents
Xing Han Lu, Siva Reddy, Harm de Vries
EACL 2023
This repository contains the code for our project. For detailed information, instructions on requesting access, API user guide and documentation, please visit the website. You can find useful links above. A quickstart is provided below.
Quickstart
First, you need to request access (please go to the main webpage for more information).
Then, you can install our Python library to load the dataset:
pip install statcan-dialogue-dataset
Now, inside Python, you can use various functions to work with the data:
import statcan_dialogue_dataset as sdd
# Download the dataset (from dataverse)
sdd.download_dataverse("your_api_token")
# Alternatively, Download from huggingface
sdd.download_huggingface("your_api_token")
# Extract ZIP into ~/.statcan_dialogue_dataset/
sdd.extract_task_data_zip(remove_zip=True)
# Load task specific split for a specific language
train_ret = sdd.load_task_data(task="retrieval", split="train", lang="en")
# Load all task conversations
task_conversations = sdd.load_task_conversations()
# Load table metadata
table = sdd.metadata.Table.from_code(10100002)
# Get subjects or surveys
subjects = table.get_subjects()
surveys = table.get_surveys()
For more information, head to the Core API Reference page.
Reproduce paper results
The full eacl_code directory contains the code used to produce the results in the paper. To reproduce the results, start by reading the README.md file in the eacl_code directory.
StatCan resources
You may find the following external resources useful:
Metadata
Release files for statcan-dialogue-dataset 0.2.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | Provenance | Actions |
|---|---|---|---|---|
| statcan-dialogue-dataset-0.2.0.tar.gz | 23.3 MB | Without provenance | Details for statcan-dialogue-dataset-0.2.0.tar.gz |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Actions Reset |
|---|---|---|---|---|
| statcan_dialogue_dataset-0.2.0-py3-none-any.whl | Python 3 | none | any | Details for statcan_dialogue_dataset-0.2.0-py3-none-any.whl |
Total release size: 46.8 MB
Release files / statcan-dialogue-dataset-0.2.0.tar.gz
| Download URL | statcan-dialogue-dataset-0.2.0.tar.gz |
|---|---|
| Size | 23.3 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
02c1a9fd0d80965d0640c518b1ba2649be7f4466bf582e80e8312228844bd122
|
|
BLAKE2b-256 checksum How to use checksums |
a1f171f3a7b000f2d885118a6a07dba5c0d4f08e2546c340ba3261204e08005c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.8.16
|
Release files / statcan_dialogue_dataset-0.2.0-py3-none-any.whl
| Download URL | statcan_dialogue_dataset-0.2.0-py3-none-any.whl |
|---|---|
| Size | 23.4 MB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
be757062b534239a28031b40c65e46c7d9ceac645cbef58defdae272f8d438b4
|
|
BLAKE2b-256 checksum How to use checksums |
09d759550d04bdd9dec035e0cb842b4193d9a5d32618384f2ceaa7d0bcba37c6
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/4.0.2 CPython/3.8.16
|
Security for statcan-dialogue-dataset 0.2.0
Provenance
Provenance describes where a file came from. On PyPI, provenance is shared via attestations, which provide a verifiable record of the build or publishing details. View details, limitations and caveats.
No provenance found
None of the files in this release were uploaded with provenance metadata.
A note on package security
PyPI is a repository for distributing packages, not a service for auditing them. While third-party security researchers and our staff do their best to detect and remove malicious packages, PyPI cannot guarantee the quality, security or suitability of any given package.
To learn more about protecting yourself from malicious actors, visit our package security documentation.