Skip to main content

Data visualization tool based on JSON files.

Project description

jsonboard

Fancy interface for ML experiments based on JSONL log files.

Install

pip install jsonboard

Logging directory

Jsonboard expected the logging directory to be structured like the following:

main_directory
├── experiment_name_1
│   ├── version_0
│   │   └── data.json
│   └── version_1
│       └── data.json 
├── experiment_name_1
│   └── version_0
│       └── data.json
└── ...

And this is a simple example of how data should be stored:

{
    "hparams": {
        "learning_rate": 1e-05,
        "batch_size": 32,
        "devices": 8,
        "accelerator": "gpu",
        "num_warmup_steps": 10000,
        "max_steps": 100000,
        "alpha": 0.5,
        "train_filepath": "datasets/wikiqa",
    },
    "metadata": {"environment": "google_cloud"},
    "logs": [
        {
            "step": 1000,
            "values": {
                "training/accuracy": 0.9
            }
        },
        {
            "step": 2000,
            "values": {
                "training/accuracy": 0.5
            }
        },
        {
            "step": 3000,
            "values": {
                "training/accuracy": 0.5
            }
        },
        {
            "step": 4000,
            "values": {
                // sometimes values may also be missing
            }
        },
        {
            "step": 5000,
            "values": {
                "training/accuracy": 0.2
            }
        }
    ]
}

Run the server

jsonboard --path /pth/to/main_directory

Additional parameters

jsonboard --help

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

JsonBoard-0.1.2.tar.gz (1.6 MB view details)

Uploaded Source

Built Distribution

JsonBoard-0.1.2-py3-none-any.whl (1.6 MB view details)

Uploaded Python 3

File details

Details for the file JsonBoard-0.1.2.tar.gz.

File metadata

  • Download URL: JsonBoard-0.1.2.tar.gz
  • Upload date:
  • Size: 1.6 MB
  • Tags: Source
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.0 CPython/3.7.11

File hashes

Hashes for JsonBoard-0.1.2.tar.gz
Algorithm Hash digest
SHA256 aec38d7cdd7e0b2b3228be6bcf6124f7f5546eba15386d48f2c3c98f8cac7dc5
MD5 d80c4734cb2cf9c05bdd8c5640d7190a
BLAKE2b-256 8af2ae8cb775522e301584a99d54c6ae48b46a462853e334fb1ea43c69e27709

See more details on using hashes here.

File details

Details for the file JsonBoard-0.1.2-py3-none-any.whl.

File metadata

  • Download URL: JsonBoard-0.1.2-py3-none-any.whl
  • Upload date:
  • Size: 1.6 MB
  • Tags: Python 3
  • Uploaded using Trusted Publishing? No
  • Uploaded via: twine/4.0.0 CPython/3.7.11

File hashes

Hashes for JsonBoard-0.1.2-py3-none-any.whl
Algorithm Hash digest
SHA256 d1c74ee03341a2c64ad328cb46ad28f4b89af65b29a4ff15b0fa677bb8391cd3
MD5 5d54560ed8bd2e52ca7fef5d36d4be41
BLAKE2b-256 b25070ad12234a1ca60005c3069e19bb07cb7fd7c1e0cf51d5149c2127ecb608

See more details on using hashes here.

Supported by

AWS AWS Cloud computing and Security Sponsor Datadog Datadog Monitoring Fastly Fastly CDN Google Google Download Analytics Microsoft Microsoft PSF Sponsor Pingdom Pingdom Monitoring Sentry Sentry Error logging StatusPage StatusPage Status page