More information about variables and context within traceback
Project description
Overview
The 'longtraceback' module is intended to be used to give more information about the context of exceptions.
Commonly it is necessary to add extra debugging into code which has gone wrong in order to discover what was happening at the time of the failure. The 'longtraceback' module aims to avoid this situation by reporting the context of the exceptions in much greater detail than the standard traceback supplied with Python.
Features
-
Function names are qualified by their path:
- Functions defined within modules include the module path
- Methods defined within classes include the module and class path
- Named functions within methods or functions are given a path through to the function name
- Function names can indicate the type of symbol that was referenced.
-
Functions include information about parameters:
- The function name can include the parameter names as a prototype (optional)
- The function name can include all the parameters as a function call (optional)
- Following the function, we can show the values of the function parameters
- Parameters which are changed since the function started are inferred (optional)
- Additional 'traceback*_' functions as used by paste and weberror
-
Source lines:
- Lines have a context lines prior to the frame point (configurable)
- Source line indentation is not stripped.
-
Local variables:
- Local variables (which have not been listed in the function header) are listed after the source lines
- Variables are trimmed to avoid instance ids (optional)
- Properties on objects are included when showing variables (optional)
-
Exception information:
- Exception message are output in the normal way.
- They are followed by any non-standard properties on the exception object.
- Syntax error exceptions do not strip the left of the line when highlighting the failure position.
-
Filenames within each frame:
- Filenames are reduced to make it easier to see where the file comes from without having very long paths.
- indicates the virtualenv directories.
- indicates the top level directory (/Library/...) on OS X
- indicates the system libraries (/System/Library/...) on OS X
- indicates the user's python library
- indicates the directory of the initially invoked script
- ~ indicates the home directory
-
Presentation:
- Blank lines can be included between each frame (optional)
- Repetitions of a given frame are detected (optional)
- Patterns of recursive parameters are reported (optional)
-
Error handling:
- When a problem occurs during frame extraction, backtraces are emitted for the failing case, and the extraction falls back to the the old style extraction.
- When a problem occurs during printing the frames, python will report the exception within the handler, before printing the original exception using the normal traceback handler.
- When a problem occurs during variable evaluation, we can optionally report the variable details (as the evaluation invokes at least 'str' or 'repr' on the value).
-
Interactions with other environments:
- Aware of virtualenv for path reduction.
- Replaces the functions in the traceback module to allow other modules to gain from the new behaviour.
- New classes replace the Frame and Line information, so that users who do not understand them will get the string behaviour they expect.
- When supplied with unaugmented extracted frame information (eg from prior to the import of this module), the functions behave sensibly, reporting as much information as they can.
- When supplied with fake frame information (eg from Jinja2 tracebacks through the template code), the presentation provides as much information as possible.
-
Colouring of exception output:
- In terminal, ANSI colouring is used to generate coloured output (optional).
- Rule-based configuration of colours allows customisation.
-
Configurable:
- User configuration file allows most features to be customised.
- Environment variable override allows configuration to be fixed in test environments.
Examples
Taken from one of the tests, the original python traceback would produce the following output:
Boing
Traceback (most recent call last):
File "test_expect/function_naming/t09_inheritance_and_super.py", line 29, in <module>
body.hit()
File "test_expect/function_naming/t09_inheritance_and_super.py", line 25, in hit
super(RubberWorld, self).hit()
File "test_expect/function_naming/t09_inheritance_and_super.py", line 14, in hit
raise Exception("Body '%s' got hit!" % (self.__class__.__name__,))
Exception: Body 'RubberWorld' got hit!
The long traceback produces the following instead:
Boing
Traceback (most recent call last):
File '<main>/t09_inheritance_and_super.py', line 29, in __main__
25 : super(RubberWorld, self).hit()
26 :
27 :
28 : body = RubberWorld(1,2,-1,+1)
29-> body.hit()
Locals:
body = <__main__.RubberWorld object>
.vx = -1
.vy = 1
.x = 1
.y = 2
File '<main>/t09_inheritance_and_super.py', line 25, in __main__.RubberWorld.hit
self = <__main__.RubberWorld object>
.vx = -1
.vy = 1
.x = 1
.y = 2
23 : def hit(self):
24 : print("Boing")
25-> super(RubberWorld, self).hit()
File '<main>/t09_inheritance_and_super.py', line 14, in __main__.Body.hit
self = <__main__.RubberWorld object>
.vx = -1
.vy = 1
.x = 1
.y = 2
13 : def hit(self):
14-> raise Exception("Body '%s' got hit!" % (self.__class__.__name__,))
Exception: Body 'RubberWorld' got hit!
Same output, but using the colouring system:
How to use
How you use the longtraceback module depends on what type of usage you intend for it.
- At the command line it can be used very simply by referencing the module and using a Python REPL shell.
- Embedded within an application, it is only necessary to import the longtraceback module to override the default traceback system.
Using the module from the command line
- Obtain a copy of the sources.
- Run the script to diagnose with:
PYTHONPATH=(path-to-module) python -mlongtraceback.shell (your-script)
For simplicity, I have a small bash script in my path called lpython
which does the equivalent for me:
#!/bin/bash
##
# Activate python with the longtraceback extensions
#
export PYTHONPATH=$HOME/projects/longtraceback/
python -mlongtraceback.shell "$@"
Configuration
The longtraceback module is configurable through a configuration file. This will be loaded on module
initialisation from the file referenced by the environment variable PYTHONLONGTRACEBACKCONFIG
, or
if it is unset, from the file ~/.python.longtraceback
.
The configuration file is a file parseable by ConfigParser (ie an .ini-like format), which contains two sections:
options
- contains the main options for the traceback systemcolours
- contains rules for colouring the output
An example file can be found in examples/python.traceback.
To display the current configuration in a form suitable for putting into the configuration file, the following commands can be used:
python -mlongtraceback.Options - display the configuration with the defaults commented out python -mlongtraceback.Options --defaults - display the configuration with the defaults present
Options
The options take the form of settings which control whether settings are enabled or not, or the
limits to which they apply. The options are described in Options.py file, and the configuration
file example. See examples/python.longtraceback
for an example configuration file containing
the descriptions of the options.
Colours
When enabled, the colours used by the module are defined within the colours
section of the
configuration file. These take the form of keys which describe the rule to match areas of
the traceback output, and a value that is a comma-separated list of the properties to use.
The rules take the form of a .-separated list of the tokens used to describe the area of
the traceback output. For example, headers within the file are always described with the
header
token. To see what tokens are used for a given traceback, the styling format option
in the main options
section can be given the value tokens
. When output as tokens,
each token will be listed in the output within <>
markers.
If a rule starts with a .
character, the rule may match anywhere within a list of tokens.
Without the leading .
, the rule matches from the start of the list.
The rule values take the form of property assignments. Properties describe how the rule should be
presented. Some properties have values (like colours), and others do not (like bold). Values
are given after an =
sign in the list. The following properties are supported:
fg
- foreground colour. Takes a named colour as a value.bg
- background colour. Takes a named colour as a value.bold
- bold enable. No value.underline
- underline enable. No value.
Colours supported are the 8 standard ANSI colours:
- black
- red
- green
- yellow
- blue
- magenta
- cyan
- white
The supplied colour scheme is suitable for a black-background terminal. It may not be ideal for white-background terminals.
For example, to change the colour of the filenames in the header, the rule used could be:
.header.file: fg=blue
A non-exhaustive list of the tokens used:
context
- part of the source context lines around the failurecontext-caret
- the caret indicating the failure in a syntax errorexception-name
- the exception name at the end of the outputfilename
- a filenamefunction-name
- a function namefunction-type
- the inferred type of the functionframe-repeated
- the message indicating the repetitions of the function frameheader
- part of the header linesheader.cause
- the messsage saying that this exception caused another one (Python 3 only)header.context
- the messsage saying that this exception was in a context (Python 3 only)header.exception
- the exception messageheader.file
- a header describing the function frameheader.locals
- the local variables headerheader.traceback
- the initial message for traceback (not used in Python 2)internal-exception
- any internal errors which occurred whilst processing tracebackline-divider
- the divider mark in the source contextline-exception
- the marker for the line the exception was onlineno
- a line number within file descriptionline-number
- the number of the source context linelocal
- a second of the local variablesparameter
- the parameter to a functionparameters
- a section of the function parametersproperty
- a property of an objectsequence-values
- the values used within the repeated framessource
- source codevarname
- a variable namevarvalue
- a variable value
Project details
Release history Release notifications | RSS feed
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.