Skip to main content

🗿 Jeff the Sipper

The infamous brother of John the Ripper. The man we all need but don't deserve. Father to murdered son, husband to a murdered wife. And he will have his vengeance, in this life or the next.

I'm not sure how well this will turn out, but the package is intended to be the FFMPEG analog for proprietary data file formats for highly specialized software systems, especially those on MS Windows which commit an extraordinary amount of sacrilege against the UNIX philosophy.

Contributing

I would love for anyone to contribute their implementation of a proprietary data file parser to enable users the option of using standardized, powerful data processing tools which, more likely than not, may overshadow the proprietary counterpart completely. If you feel inclined, fork the repository, implement it, and submit a pull request.

If you would like to implement the data parser in a different programming language, that is completely fine, but it would be best to integrate it into Python if at all possible.

AVANTES AvaSoft 8 AVS84

My attempt to reverse engineer the AVS84 (i.e ".raw8" or RAW 8) file format generated by the AVANTES AvaSoft 8 spectrometer analyzer.

My internet searches yielded quite literally nothing regarding the structure of the AVS84 file, so the format is hypothesized through the analysis of several such files against their renditions into Excel, CSV, and plaintext through AvaSoft itself. The sole resource found regarding this format was by another GitHub user @padmer who also extracted only the parts they cared about.

Format

As of this commit, the format currently known is as follows:

HEADER

address type description size (bytes)
0x0000 ascii-string "AVS84" 5
0x0005 block ? 9
0x000e ascii-string spectrometer serial ID 9
0x0017 block ? 1
0x0018 ascii-string spectrometer serial ID 9
0x0021 block null padding? 3
0x0024 block ? 292

SERIES

address type description size (bytes)
0x0148 f32 [] X axis 13600 ?
0x3668 f32 [] Y axis 13600 ?
0x6b88 f32 [] Z axis ? 13600 ?

FOOTER

address type description size (bytes)
0xa0a8 block null padding? 13612 ?
0xd5d4 f32 constant 1.0f? 4
0xd5d8 block null padding? 5
0xd5dd block constant 10.0f array? 1884
0xdd39 block null padding? 1883

Observations

Data is stored in little endian (LE) format with allegiance to the IEEE-754 floating point standard.


Per @padmer's implementation, the size of the data series is clearly arbitrary, but my attempts of finding the address related to the series size has been unsuccessful. My presumption is that this size must be of an Int32 type located somewhere in the HEADER.


Most MYSTERY chunks are consistent accross different data files, but the 6-byte MYSTERY chunk in the HEADER appears to change with each file. My presumption is that it is either a hash of the data series, or a timestamp in some encoding. My observations noted that this MYSTERY chunk appears to be 6 bytes in length, which is rather peculiar.

Metadata

Release files for sipper 0.0.6

For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.

Source distribution (sdist)

Source distribution for sipper 0.0.6
File Size Uploaded
sipper-0.0.6.tar.gz 22.4 kB Details

Built distribution (wheel)

Table of built distributions (wheels) for sipper 0.0.6
File Interpreter ABI Platform
sipper-0.0.6-py3-none-any.whl Python 3 none any Details

Total release size: 45.2 kB

Release files / sipper-0.0.6.tar.gz

Download URL sipper-0.0.6.tar.gz
Size 22.4 kB
Tags Source
SHA-256 checksum
How to use checksums
759f701b3aedc80e044d956a8e62baa85cac56bfd62ad210578a02ec9a8f4c19
BLAKE2b-256 checksum
How to use checksums
7e1294215d1228bd168d00d62f2cf1edd8ce25888091b72861d9ca427fe64eae
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.8.10

Release files / sipper-0.0.6-py3-none-any.whl

Download URL sipper-0.0.6-py3-none-any.whl
Size 22.8 kB
Tags Python 3
SHA-256 checksum
How to use checksums
5d65f3eccc6a7295abb1b463153e656d8964046e358d7c8c015bff836fd5eb63
BLAKE2b-256 checksum
How to use checksums
49818588a5a6a54e2960725dc49dfb2a07f1b95c4d46fc76406a156d6626f2de
Upload date
Uploaded using Trusted Publishing?
What is trusted publishing?
No
Uploaded via twine/3.4.1 importlib_metadata/4.5.0 pkginfo/1.7.0 requests/2.22.0 requests-toolbelt/0.9.1 tqdm/4.61.1 CPython/3.8.10

Release history Release notifications | RSS feed

This release

0.0.6 This release

2 release files

0.0.5

2 release files

0.0.4

2 release files

0.0.3

2 release files

0.0.2

2 release files

Anthropic, PBC Visionary sponsor Bloomberg Visionary sponsor Hudson River Trading Visionary sponsor Meta Visionary sponsor NVIDIA Visionary sponsor Microsoft Sustainability sponsor Depot Continuous Integration AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Sentry Error logging StatusPage Status page