Skip to main content

A Measured Data Format file parser

Project description

**MDFREADER**
**************

Abstract:
=========
This Module imports MDF files (Measured Data Format V3.x and V4.x), typically from INCA (ETAS), CANape or CANOe. It is widely used in automotive industry to record data from ECUs. The main module mdfreader.py inherits from 2 modules (One pair for each MDF version X) : The first one to read the file's blocks descriptions (mdfinfoX) and the second (mdfXreader) to read the raw data from the file. It can optionally run multithreaded and I am proud to say I did not see any other tool reading faster this kind of files --> makes it suitable to process big amount of data in a batch, generally data from endurance evaluation.

The structure of the mdf dictionary, for each channel: mdf[channelName]
=======================================================================
- data: numpy vector
- unit: unitName
- master : vector name corresponding to master channel
- masterType : type of master channel (time, angle, distance, etc.)
- description : physical meaning of channel
- conversion: (optional) dictionary describing how to convert raw data into meaningful/physical data

Mdfreader module methods:
=========================
- re-sample channels to one sampling frequency
- merge files
- plot a simple or a list of channels
It is also possible to export mdf data into:
- CSV file (excel dialect by default)
- NetCDF file for a compatibility with Uniplot for instance (needs netcdf4, Scientific.IO)
- HDF5 (needs h5py)
- Excel 95 to 2003 (needs xlwt, really slooow, be careful about data size)
- Excel 2007/2010 (needs openpyxl, slow if not resampled data)
- Matlab .mat (needs scipy.io)
- MDF 3.3 simplified file. It allows you to modify data, units, description and save it again
- Pandas dataframe(s) (only in command line). One dataframe per raster.

Compatibility:
==============
This code is compatible for both python 2.6-7 and python 3.2+
Evaluated for Windows and Linux platforms (x86 and AMD64)

Requirements:
=============
Mdfreader is mostly relying on numpy/scipy/matplotlib.
If reading not byte aligned bitarray.
Reading channels defined by a formula will require sympy.
Export requirements (optional): scipy, csv, h5py, xlwt(3), openpyxl, pandas
Mdfconverter user interface requires pyQT

User interface: mdfconverter (PyQt4)
==================================
User interface in PyQT4 to convert batch of files is also written. You can launch it with command mdfconverter. By right clicking a channel in the interface list, you can plot it. You can also drag-drop channels between columns to tune import list. Channel list from a .lab text file can be imported. You can optionally merge several files into one and even resample all of them.

Others:
=======
In the case of big files and lack of memory, you can optionally:
- Read only a channel list (slightly slower, argument channelList = ['channel', 'list'])
- Keep raw data as stored in mdf without data type conversion (mdfreader argument convertAfterRead=False). Data will then be converted on the fly by the other functions (plot, exportTo..., getChannelData, etc.) but raw data will remain as in mdf file along with conversion information.

Warning:
========
MDF 4.x specification is much complex compared to 3.x and its implementation is young. Even though I tested it with around 150 different files, chances of bug is higher with version 4.x compared to 3.x

For great data visualization, dataPlugin for Veusz (from 1.16, http://home.gna.org/veusz/) is also existing ; please follow instructions from Veusz documentation and plugin file's header.

Can be downloaded at this `link <https://drive.google.com/open?id=0B7B2LHSheZ5qdU9HaXJBMkpQQU0&authuser=0>`_

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

mdfreader-0.1.8.tar.gz (622.4 kB view details)

Uploaded Source

Built Distribution

If you're not sure about the file name format, learn more about wheel file names.

mdfreader-0.1.8-py2.py3-none-any.whl (65.4 kB view details)

Uploaded Python 2Python 3

File details

Details for the file mdfreader-0.1.8.tar.gz.

File metadata

  • Download URL: mdfreader-0.1.8.tar.gz
  • Upload date:
  • Size: 622.4 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for mdfreader-0.1.8.tar.gz
Algorithm Hash digest
SHA256 158d33f1bda7c2719267b94561238473a53af61702a0cae683ceb7e0d7fe9c9c
MD5 13222dfb39b70e4557063dbac17e98cc
BLAKE2b-256 64ae1bd028712c2ca83fae70e267e393d722ed6749f1f3bc0f719c84577b1db2

See more details on using hashes here.

File details

Details for the file mdfreader-0.1.8-py2.py3-none-any.whl.

File metadata

File hashes

Hashes for mdfreader-0.1.8-py2.py3-none-any.whl
Algorithm Hash digest
SHA256 5ecf44c4377103148d3d42c9b964867ad2634ee452984bd14846474f5ad74b21
MD5 1e1a4bd992e7cd8918470360b2ec0f71
BLAKE2b-256 aa961e5f303cffe35a83e34926bf010824cb343903dc05516d3f3f9b98476024

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Depot Continuous Integration Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page