jfinqa-helm
HELM plugin for JFinQA: Japanese Financial Numerical Reasoning QA Benchmark.
Installation
pip install crfm-helm jfinqa-helm
Usage
helm-run --run-entries jfinqa:model=openai/gpt-4o
About JFinQA
JFinQA contains 1,000 questions across three subtasks:
- numerical_reasoning (550 questions): Calculate financial ratios, growth rates, etc.
- consistency_checking (200 questions): Verify whether a statement is consistent with financial data
- temporal_reasoning (250 questions): Reason about changes over multiple fiscal years
Questions are drawn from 68 companies' EDINET filings covering J-GAAP, IFRS, and US-GAAP.
Dataset: ajtgjmdjp/jfinqa
License
Apache-2.0
1 maintainer
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
jfinqa_helm-0.1.0.tar.gz
(2.9 kB
view details)
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file jfinqa_helm-0.1.0.tar.gz.
File metadata
- Download URL: jfinqa_helm-0.1.0.tar.gz
- Upload date:
- Size: 2.9 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.10.0 {"installer":{"name":"uv","version":"0.10.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0b9c8b0110506a58256c9d026167976d78ddb393e62751b8ba9c0ee2aabeb317
|
|
| MD5 |
96d178628c7aaec624edd4228987f0f8
|
|
| BLAKE2b-256 |
c32bf00d417d87f9e4d274d2558b36bfa4dad853f8cdbb8a83261f2c29705b8e
|
File details
Details for the file jfinqa_helm-0.1.0-py3-none-any.whl.
File metadata
- Download URL: jfinqa_helm-0.1.0-py3-none-any.whl
- Upload date:
- Size: 4.0 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
uv/0.10.0 {"installer":{"name":"uv","version":"0.10.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
0d91856524882afaf5bc6b9fbd06fb1fc8b5b492c3a90f4107523e880d8882c2
|
|
| MD5 |
1b38b6d9125b8b6f9abc80fd58b42bd9
|
|
| BLAKE2b-256 |
c89dbf95476e268982be33aff172ec5a3f0c0de2e476ca59b2c1c970eb84e367
|
