tlparse: Parse structured PT2 logs
tlparse parses structured torch trace logs and outputs HTML files analyzing data.
Quick start: Run PT2 with the TORCH_TRACE environment variable set:
TORCH_TRACE=/tmp/my_traced_log_dir example.py
Feed input into tlparse:
tlparse /tmp/my_traced_log_dir -o tl_out/
Adding custom parsers
You can extend tlparse with custom parsers which take existing structured log data and output any file. To do so, first implement StructuredLogParser with your own trait:
pub struct MyCustomParser;
impl StructuredLogParser for MyCustomParser {
fn name(&self) -> &'static str {
"my_custom_parser"
}
fn get_metadata<'e>(&self, e: &'e Envelope) -> Option<Metadata<'e>> {
// Get required metadata from the Envelope.
// You'll need to update Envelope with your custom Metadata if you need new types here
....
}
fn parse<'e>(&self,
lineno: usize,
metadata: Metadata<'e>,
_rank: Option<u32>,
compile_id: &Option<CompileId>,
payload: &str
) -> anyhow::Result<ParserResult> {
// Use the metadata and payload however you'd like
// Return either a ParserOutput::File(filename, payload) or ParserOutput::Link(name, url)
}
}
How to release
- Make a release commit by updating Cargo.toml and then running cargo update
- Push the release commit and a tag for it. This will trigger PyPI release
- cargo publish
Release files for tlparse 0.4.3
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| tlparse-0.4.3.tar.gz | 5.9 MB | Details |
Built distributions (wheels)
Total release size: 29.6 MB
Release files / tlparse-0.4.3.tar.gz
| Download URL | tlparse-0.4.3.tar.gz |
|---|---|
| Size | 5.9 MB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
5fc8208a465e532e8dbbad62fefdc712cda9d7a0a28ab4f170c18193f83aba9d
|
|
BLAKE2b-256 checksum How to use checksums |
83791ca1d6023f6a79430958e7f547b19344b9620a39b69e4f5dbb71700e86f7
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-win_amd64.whl
| Download URL | tlparse-0.4.3-py3-none-win_amd64.whl |
|---|---|
| Size | 2.0 MB |
| Tags | Python 3 Windows x86-64 |
|
SHA-256 checksum How to use checksums |
cb5cbc670aca4034736e1b2f001cb99c8ff52edcec6126ec7418f69641248077
|
|
BLAKE2b-256 checksum How to use checksums |
1f8724cf14b52adc1a0884d1fa345424ac4c5da670abec558b3eb85e83f56a95
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-win32.whl
| Download URL | tlparse-0.4.3-py3-none-win32.whl |
|---|---|
| Size | 1.9 MB |
| Tags | Python 3 Windows x86-32 |
|
SHA-256 checksum How to use checksums |
b3f19ee15262c0f16c1d37255638dd47fc8165e870a7c5ca5bc932885504c746
|
|
BLAKE2b-256 checksum How to use checksums |
86aaca33edc91ddf3c745f7ed5e40a436dca57744d3a2d1065866f905d776b50
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl
| Download URL | tlparse-0.4.3-py3-none-manylinux_2_17_x86_64.manylinux2014_x86_64.whl |
|---|---|
| Size | 2.5 MB |
| Tags | Linux glibc 2.17+ x86-64 Python 3 |
|
SHA-256 checksum How to use checksums |
cf0b613cf91ddc74b8e20b23f09d70fa5f1426a2019dce7e4139ae28a2b9053c
|
|
BLAKE2b-256 checksum How to use checksums |
72bfd261cdbc338ca497ffe27cdd7b49cd1c9de756e95e1429b8aa8c29b7cc9c
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-manylinux_2_17_s390x.manylinux2014_s390x.whl
| Download URL | tlparse-0.4.3-py3-none-manylinux_2_17_s390x.manylinux2014_s390x.whl |
|---|---|
| Size | 2.6 MB |
| Tags | Linux glibc 2.17+ IBM System/390x Python 3 |
|
SHA-256 checksum How to use checksums |
3f2a15aaff8dbdf1adac407033534be71695bbc50248686d6cabed5bd88523c5
|
|
BLAKE2b-256 checksum How to use checksums |
fac49b74543fc4a54de19c5a250f8b76a8a36a630ed2007392e6ea845852a33f
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl
| Download URL | tlparse-0.4.3-py3-none-manylinux_2_17_ppc64le.manylinux2014_ppc64le.whl |
|---|---|
| Size | 2.7 MB |
| Tags | Linux glibc 2.17+ PowerPC 64-le Python 3 |
|
SHA-256 checksum How to use checksums |
6deb673b0287252e9bd7608ba16839e0f7d39eb28953b38c04311f8b436b146b
|
|
BLAKE2b-256 checksum How to use checksums |
0705f13a7eabb5f279ad4b9143ffadb1e9cf4ff1aebabc2346a2db6fc317bfbe
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-manylinux_2_17_i686.manylinux2014_i686.whl
| Download URL | tlparse-0.4.3-py3-none-manylinux_2_17_i686.manylinux2014_i686.whl |
|---|---|
| Size | 2.6 MB |
| Tags | Linux glibc 2.17+ x86-32 Python 3 |
|
SHA-256 checksum How to use checksums |
60cc97be1ad54d7e43241d94271760070375a8a815af9f0d037948f042268774
|
|
BLAKE2b-256 checksum How to use checksums |
f58ca8408e222744bb65a21731d003de0a2f512a54c82191b2e186a93fc14d69
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-manylinux_2_17_armv7l.manylinux2014_armv7l.whl
| Download URL | tlparse-0.4.3-py3-none-manylinux_2_17_armv7l.manylinux2014_armv7l.whl |
|---|---|
| Size | 2.3 MB |
| Tags | Linux glibc 2.17+ ARMv7l Python 3 |
|
SHA-256 checksum How to use checksums |
9649b60e3efb57e6bed1dc1c79dc940492e8d3aa3a8663a2f2a83e8aaa5b86db
|
|
BLAKE2b-256 checksum How to use checksums |
3b36842c1a9cdfd97d5d69843f08d013bdfca015b4826d62c5c9cf6d60d6ca6e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl
| Download URL | tlparse-0.4.3-py3-none-manylinux_2_17_aarch64.manylinux2014_aarch64.whl |
|---|---|
| Size | 2.4 MB |
| Tags | Linux glibc 2.17+ ARM64 Python 3 |
|
SHA-256 checksum How to use checksums |
284aba9623fb4fa4282d36ae50d9e7f2cbef66f4bcb65c621a203f5cb3086e2e
|
|
BLAKE2b-256 checksum How to use checksums |
d2cc8934441d69254e6a5ab6da73e5ea3044bf1081045cfc3c9b537beeaaa9ca
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-macosx_11_0_arm64.whl
| Download URL | tlparse-0.4.3-py3-none-macosx_11_0_arm64.whl |
|---|---|
| Size | 2.2 MB |
| Tags | Python 3 macOS 11.0+ ARM64 |
|
SHA-256 checksum How to use checksums |
e114130439f019a67f9856bcd5ef9eaf267994dc565e5d973906e5b79d6329dd
|
|
BLAKE2b-256 checksum How to use checksums |
b7b73b66de797619e8f8ee26c78e11661b2b3e67adcfdbb0ca15891ca416b375
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
Release files / tlparse-0.4.3-py3-none-macosx_10_12_x86_64.whl
| Download URL | tlparse-0.4.3-py3-none-macosx_10_12_x86_64.whl |
|---|---|
| Size | 2.3 MB |
| Tags | Python 3 macOS 10.12+ x86-64 |
|
SHA-256 checksum How to use checksums |
bf87bbf8286463ae34e6b3cbbd467438c081e5be7860399522ecca646319b14e
|
|
BLAKE2b-256 checksum How to use checksums |
b9ee28816a19d6a34bc0e33d1aa35eacbe934182bca4ce7f2905a99117d0632e
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
Yes |
| Uploaded via |
maturin/1.9.4
|
