strym-stripped 0.5.1

A real time CAN data analysis tool.

Strym

Citation

Please cite our work as follows if you have used Strym:

Bhadani, Rahul, Matt Bunting, Matthew Nice, Ngoc Minh Tran, Safwan Elmadani, Dan Work, and Jonathan Sprinkle.
Strym: A python package for real-time can data logging, analysis and visualization to work with usb-can interface."
In 2022 2nd Workshop on Data-Driven and Intelligent Cyber-Physical Systems for Smart Cities Workshop (DI-CPS), pp. 14-23. IEEE, 2022.

@inproceedings{bhadani2022strym,
  title={Strym: A python package for real-time can data logging, analysis and visualization to work with usb-can interface},
  author={Bhadani, Rahul and Bunting, Matt and Nice, Matthew and Tran, Ngoc Minh and Elmadani, Safwan and Work, Dan and Sprinkle, Jonathan},
  booktitle={2022 2nd Workshop on Data-Driven and Intelligent Cyber-Physical Systems for Smart Cities Workshop (DI-CPS)},
  pages={14--23},
  year={2022},
  organization={IEEE}
}

A python package for real-time CAN data logging, analysis and visualization to work with USB-CAN Interface.

Strym is a python package that provides APIs to interface with COMMA.AI panda for logging CAN data, analysis and visualization in real-time from supported modern vehicles such Toyota RAV4 and Honda Pilot. There are two kinds of functionality that Strym provides:

1. Real-time visualization of CAN data through comma.ai Panda and Giraffe connector.
2. Offline analysis and visualization of CAN Data from a CSV Formatted file.

Quick Installation

conda create -n strym python=3.7.5
conda activate strym
pip install -r https://github.com/jmscslgroup/strym/releases/download/0.4.3/requirements_strym.txt
pip install strym

Philosophy behind Strym

Strym data is capable of handling timeseries data obtained from Comma.ai Panda and Giraffe Connector. Most functions and methods in strym expects timeseries data of following format

	Time	Message
1	1582056042.5040324	2.0
2	1582056043.5040324	2.1
3	1582056044.5040324	2.12
4	1582056045.5040324	1.98
5	1582056046.5040324	1.6

Here, data should be of type Pandas.DataFrame with two columns: Time and Message.

However, scope of strym is not limited to timeseries data obtained from comma.ai Panda. Any timeseries data of above format is capable of harnessing methods available in strym.

Quick Start for CAN Data Analysis and Visualization

You can use Strym for quick visualization by importing strymread:

import strym
from strym import strymread
from strym import ranalyze
import matplotlib.pyplot as plt
import pandas as pd
from pylab import rcParams
import strym.DBC_Read_Tools as dbc
import numpy as np
plt.rcParams["figure.figsize"] = (16,8)
rcParams.update({'font.size': 40})
dbcfile = '/home/ivory/VersionControl/Jmscslgroup/strym/examples/newToyotacode.dbc'
r =strymread(csvfile="/home/ivory/CyverseData/JmscslgroupData/PandaData/2020_02_18/2020-02-18-13-00-42-209119__CAN_Messages.csv", dbcfile=dbcfile)

Checkout documentation at https://jmscslgroup.github.io/strym/getting_started.html for more in-depth tutorials.

Software Requirements

• Ubuntu 18.04 (not tested on any other version of Ubuntu, but might work)
• Python 3.x ( I recommend using python 3.7.5 so as not to get caught in dependency hell as develop is being done using python 3.7.5, and recen pip changes are not dependency-friendly).

Note about installation on RASPBERRY PI for CAN Data Logging

If you are going to install the package on RASPBERRY PI, I highly recommend installing Python 3.7 from the source as there is no Py3.7 release for Raspberry PI. You will also need to install pre-compiled binaries for NumPy otherwise you may encounter huge inconvenience while building NumPy wheels for Raspberry PI.

Hardware Requirements for CAN Logging

• comma.ai CAN-USB Panda board.
• comma.ai Giraffee Connector
• A modern vehicle with CAN Bus available such as Toyota RAV4, Toyota CHR, etc.

Installation Instructions

Install Python

Install Python 3, either through anaconda or using the Ubuntu package manager. Alternatively, you can also build Python 3.7.5 from source as explained below:

sudo apt-get update -y
sudo apt-get install build-essential tk-dev libncurses5-dev libncursesw5-dev libreadline6-dev libdb5.3-dev libgdbm-dev libsqlite3-dev libssl-dev libbz2-dev libexpat1-dev liblzma-dev zlib1g-dev libffi-dev -y

wget https://www.python.org/ftp/python/3.7.5/Python-3.7.5.tar.xz
tar xf Python-3.7.5.tar.xz
cd Python-3.7.5
./configure
make -j 4
sudo make altinstall

I recommend using python's virtual environment for python package installation. For the sake of following instructions, let's assume that you are using the virtualenv package to create a python virtual environment.

sudo apt install virtualenv

First, create a directory where your virtual environment folder will reside.

mkdir ~/VirtualEnv

Now, we will create a python virtual environment using python3.7. Let's name the virtual environment stream.

cd ~/VirtualEnv
virtualenv --python=python3.7.5 strym

Activate the virtual environment by typing:

source ~/VirtualEnv/stream/bin/activate

Alternatively, you can use Anaconda to create a virtual evinronment and activate it:

conda create -n strym python=3.7.5
conda activate strym

Install strym

pip install strym

This will install the strym package in your stream virtual environment.

Now you are ready to use Strym.

Usage for Real-Time Visualization of CAN messages using Strym

Plug your Comma AI Panda device using Giraffe Connector to your CAR's OBD port for data logging and streaming. Insert one end of the USB to Panda Device and another end to your laptop.

In python, you will be required to create an object of type Strym:

See strym_impl.py for one such usage example in the example folder, however, I am provided details of an example below:

Create a new file. I will use the gedit to create a new file. You will be required to pass a path of the CAN Database DBC file to strym while instantiating its object. Once you have a strym object, you can call its isoviz() function. isoviz() function takes two arguments: i) the message type that you want to visualize, e.g. SPEED ii) attribute number to plot specific signal of the desired message type. isoviz() function will simultaneously capture CAN message in a CSV file and also plot the desired message's signal. To terminate, press CTRL-C. Upon pressing CTRL-C, a SIGINT signal handler will be called that will terminate the logging of CAN messages and also save a matplotlib figure of the desired message's signal in pdf and pickle format.

gedit viz_example.py

from strym import strym
import cantools
import sys, math, time
import signal

db = './newToyotacode.dbc'

Viz = strym(dbcfile = db)

message_type_to_visualize = 'SPEED'
message_attribute_number_to_visualize = 1

visualize = False
options = {"log": "info" }
Viz.isolog(visualize, message_type_to_visualize, message_attribute_number_to_visualize,  **options)

signal.signal(signal.SIGINT, Viz.kill)

print('Datafile saved is {}'.format(Viz.logfile))

You will need a DBC file to parse can messages. Download an example DBC file here

To run the above program:

source ~/VirtualEnv/stream/bin/activate
python viz_example.py`

If you are done, press CTRL-C.

Issues

If you run into any issues, please use the issue feature of GitHub to log your issues. I will try my best to address any issue as soon as possible.

For an issue related to installation/use on windows, please see following filed issues:

1. Issue #8: OSError: [WinError 126]

Contributing to this project

If you like to contribute to this project, please fork this repository to your GitHub account, create a new branch for yourself and send a pull request for the merge. After reviewing the changes, we will decide if this is a good place to add your changes.

Authors and Contributors

• Rahul Bhadani ( [e-mail])
• Jonathan Sprinkle ([e-mail])
• Gustavo Lee ([e-mail])
• Matthew Nice ([e-mail])
• George Gunter ([e-mail])
• Safwan Elmadani ([e-mail])

Licensing

License: MIT License 
Copyright 2019-2020 Rahul Bhadani, Jonathan Sprinkle, Arizona Board of Regents
Initial Date: Nov 12, 2019
Permission is hereby granted, free of charge, to any person obtaining 
a copy of this software and associated documentation files 
(the "Software"), to deal in the Software without restriction, including
without limitation the rights to use, copy, modify, merge, publish,
distribute, sublicense, and/or sell copies of the Software, and to 
permit persons to whom the Software is furnished to do so, subject 
to the following conditions:

The above copyright notice and this permission notice shall be 
included in all copies or substantial portions of the Software.

THE SOFTWARE IS PROVIDED "AS IS", WITHOUT WARRANTY OF 
ANY KIND, EXPRESS OR IMPLIED, INCLUDING BUT NOT LIMITED 
TO THE WARRANTIES OF MERCHANTABILITY, FITNESS FOR A 
PARTICULAR PURPOSE AND NONINFRINGEMENT. IN NO EVENT 
SHALL THE AUTHORS, COPYRIGHT HOLDERS OR ARIZONA BOARD OF REGENTS
BE LIABLE FOR ANY CLAIM, DAMAGES OR OTHER LIABILITY, WHETHER IN 
AN ACTION OF CONTRACT, TORT OR OTHERWISE, ARISING FROM, 
OUT OF OR IN CONNECTION WITH THE SOFTWARE OR THE USE 
OR OTHER DEALINGS IN THE SOFTWARE.