Skip to main content

A very simple CEF parser.

Project description

# pycef A very simple CEF parser for Python 2/3

I originally wrote this because I wasn’t able to find very many good Python CEF parsers out there. I did find [one by Sooshie](https://github.com/sooshie/cef_parser) that got me started (thanks for sharing, sir!), but I elected to produce my own.

The parse function takes a string containing a single CEF record and returns a dict containing the following keys, as defined in the [CEF format documentation](https://www.protect724.hpe.com/docs/DOC-1072):

  • CEFVersion
  • DeviceVendor
  • DeviceVersion
  • DeviceEventClassID
  • DeviceName
  • DeviceSeverity

If there are any key=value pairs in the “extensions” section (and face it, pretty much every CEF record has these), they’ll also be in the dict, with the dict key name the same as the CEF record’s key name. If it could not recognize any CEF data, the parse function will return None.

## Example Usage Parsing a well-formatted CEF record

>>> import pycef
>>> cef = 'CEF:0|pycef|python CEF tests|1|2|Test event 1|3| field1=value1 field2=value2 field3=value3'
>>> d = pycef.parse(cef)
>>> d
{'DeviceVendor': 'pycef', 'DeviceProduct': 'python CEF tests', 'DeviceVersion': '1', 'DeviceEventClassID': '2', 'DeviceName': 'Test event 1', 'DeviceSeverity': '3', 'CEFVersion': '0', 'field1': 'value1', 'field2': 'value2', 'field3': 'value3'}

Parsing a line of CEF from a source with header junk at the front (NOTE: this isn’t specific to syslog headers as in the example. The parser just starts wherever ‘CEF:0’ is found):

>>> import pycef
>>> cef_syslog = 'Nov 16 21:24:18 arcsightfwd.davidbianco.io CEF:0|pycef|python CEF tests|1|2|Test event 1|3| field1=value1 field2=value2 field3=value3'
>>> d = pycef.parse(cef_syslog)
>>> d
{'DeviceVendor': 'pycef', 'DeviceProduct': 'python CEF tests', 'DeviceVersion': '1', 'DeviceEventClassID': '2', 'DeviceName': 'Test event 1', 'DeviceSeverity': '3', 'CEFVersion': '0', 'field1': 'value1', 'field2': 'value2', 'field3': 'value3'}

## Logging Pycef uses the standard Python logging module. By default, you will not see any logs, but you can easily configure them within your own application. Here’s an example:

import logging

# We log with the name ‘pycef’ logger = logging.getLogger(‘pycef’)

# set log level to DEBUG to get the most verbose output logger.setLevel(logging.DEBUG)

ch = logging.StreamHandler() ch.setLevel(logging.DEBUG) formatter = logging.Formatter(‘%(asctime)s - %(name)s - %(levelname)s - %(message)s’) ch.setFormatter(formatter) logger.addHandler(ch)

# well-formatted CEF data will log the parsed values at DEBUG level cef = ‘CEF:0|pycef|python CEF tests|1|2|Test event 1|3| field1=value1 field2=value2 field3=value3’ d = pycef.parse(cef) 2018-11-23 08:49:39,827 - pycef - DEBUG - Returning values: {‘DeviceVendor’: ‘pycef’, ‘DeviceProduct’: ‘python CEF tests’, ‘DeviceVersion’: ‘1’, ‘DeviceEventClassID’: ‘2’, ‘DeviceName’: ‘Test event 1’, ‘DeviceSeverity’: ‘3’, ‘CEFVersion’: ‘0’, ‘field1’: ‘value1’, ‘field2’: ‘value2’, ‘field3’: ‘value3’}

# Parse errors in the data will log at WARNING level pycef.parse(‘kjlk’) 2018-11-23 08:47:42,853 - pycef - WARNING - Could not parse record. Is it valid CEF format?

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for pycef, version 1.10
Filename, size File type Python version Upload date Hashes
Filename, size pycef-1.10-py3-none-any.whl (5.1 kB) File type Wheel Python version py3 Upload date Hashes View hashes
Filename, size pycef-1.10.tar.gz (4.0 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page