jfinqa-helm
HELM plugin for JFinQA: Japanese Financial Numerical Reasoning QA Benchmark.
Installation
pip install crfm-helm jfinqa-helm
Usage
helm-run --run-entries jfinqa:model=openai/gpt-4o
About JFinQA
JFinQA contains 1,000 questions across three subtasks:
- numerical_reasoning (550 questions): Calculate financial ratios, growth rates, etc.
- consistency_checking (200 questions): Verify whether a statement is consistent with financial data
- temporal_reasoning (250 questions): Reason about changes over multiple fiscal years
Questions are drawn from 68 companies' EDINET filings covering J-GAAP, IFRS, and US-GAAP.
Dataset: ajtgjmdjp/jfinqa
License
Apache-2.0
1 maintainer
Metadata
1 maintainer
Release files for jfinqa-helm 0.1.0
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| jfinqa_helm-0.1.0.tar.gz | 2.9 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| jfinqa_helm-0.1.0-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 7.0 kB
Release files / jfinqa_helm-0.1.0.tar.gz
| Download URL | jfinqa_helm-0.1.0.tar.gz |
|---|---|
| Size | 2.9 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
0b9c8b0110506a58256c9d026167976d78ddb393e62751b8ba9c0ee2aabeb317
|
|
BLAKE2b-256 checksum How to use checksums |
c32bf00d417d87f9e4d274d2558b36bfa4dad853f8cdbb8a83261f2c29705b8e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.0 {"installer":{"name":"uv","version":"0.10.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
Release files / jfinqa_helm-0.1.0-py3-none-any.whl
| Download URL | jfinqa_helm-0.1.0-py3-none-any.whl |
|---|---|
| Size | 4.0 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
0d91856524882afaf5bc6b9fbd06fb1fc8b5b492c3a90f4107523e880d8882c2
|
|
BLAKE2b-256 checksum How to use checksums |
c89dbf95476e268982be33aff172ec5a3f0c0de2e476ca59b2c1c970eb84e367
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
uv/0.10.0 {"installer":{"name":"uv","version":"0.10.0","subcommand":["publish"]},"python":null,"implementation":{"name":null,"version":null},"distro":{"name":"macOS","version":null,"id":null,"libc":null},"system":{"name":null,"release":null},"cpu":null,"openssl_version":null,"setuptools_version":null,"rustc_version":null,"ci":null}
|
