Pedal
A collection of tools to analyze student’s work in a pipeline. Pedal not only provides some of these tools, but it provides a framework around those tools.
Installation
> pip install pedal
Or install from the [GitHub](https://github.com/acbart/pedal).
Important Concepts
Report: A collection of Feedback and a namespace for the results of Tools, accessible by the Tool name. Reports can be generated imperatively (using the default Report, similar to MatPlotLib) or by explicitly creating and passing Report objects.
Tool: A system that can read and write to a Report, building on the work of previous Tools.
Resolver: A system that can analyze a Report and create a relevant bit of output for another system (e.g., BlockPy, Web-CAT).
Feedback: A structured representation of content to be delivered to a student in response to their submission of work.
We base our idea of “Feedback” on concepts established by Narciss 2006. Our Feedback objects are composed of up to 7 components:
result (bool): Whether or not this feedback is associated with the learner completing the task (“Success!”)
performance (float): A relative amount that this feedback contributes to the students’ performance (think in terms of partial credit, like “Triggering this feedback is worth 20%”).
misconceptions (Component): A description of the misconception that is believed to be in the student’s mind, or perhaps the relevant concept from the material that should be associated with this. (“Variables must be initialized before they are used.”)
mistakes (Component): A description of the error or bug that the student has created (“NameError on line 5: sum has not been defined”)
hints (Component): A suggestion for what the student can do (“Initialize the sum variable one line 1”)
constraints (Component): A description of the task requirements or task type that the student has violated (“You used a for loop, but this question expected you to use recursion.”)
metacognitives (Component): A suggestion for more regulative strategies (“You have been working for 5 hours, perhaps it is time to take a break?”)
One of these components is described by the following union type, where a Component is one of:
A str field representing renderable text for a student
An object with a “message (str)” field of renderable text for a student, along with whatever other fields are useful (e.g., the line number of the error)
A list of Components
Additionally, a given Feedback object has the following metadata:
label (str): An internal name for this specific piece of feedback. This is particularly useful for us for research purposes (we currently show it in italics as part of the message)
tool (str): An internal name for indicating the tool that created this feedback (e.g., “tifa” or “source”)
category (str): A human-presentable name showable to a student (this is like the “Analyzer Error” message in the top left of our BlockPy boxes).
priority (str): An indication of how important this feedback is. Might be “high/medium/low” or the name of a category to supersede.
Tools
Source
from pedal.source import set_source
STUDENT_CODE = "message='Hello World'\nprint(message)"
set_source(STUDENT_CODE)One of the simplest tools, the Source tool provides a function for attaching source code to a Report. It is a requirement for any tool that wants to do code analysis. But notice that this tool is not required in general - you could find other ways to attach code (e.g., a History tool that attaches all previous code written) or other aspects of the students’ performance (e.g., a Demographics tool to attach bio-data about the student).
TIFA
from pedal.tifa import tifa_analysis
tifa_analysis()Tifa is a Type Inferencer and Flow Analyzer. Its goal is not to be a general purpose tool for doing so, but to be focused on simplistic code written in pedagogical settings. This means that it can make a lot of assumptions and forbid a lot of features. Further, it’s primary job is not just to collect type information, but to detect issues in the code (e.g., a variable changes type, a variable is not read, a variable is defined in one scope then used in another).
CAIT
from pedal.cait import parse_program, find_matches
root = parse_program()
# ... or ...
matches = find_matches("_var_ = __expr__")Capturer for AST Inclusion Trees. Its goal is to take a a desired AST and a target AST, and captures trees in the target ast that include the desired AST. A metaphor might be “Regular Expressions for source code”.
Mistakes
from pedal.mistakes.instructor_iteration import *
missing_for_slot_empty()
# ...A collection of code configuration patterns that represent common mistakes for students. These mistakes are grouped together by topics.
Toolkit
from pedal.toolkit.utilities import *
prevent_operation('+')
ensure_literal(7)
from pedal.toolkit.functions import function_signature
function_signature('search', needle='str', haystack='list[str]',
returns='bool')A collection of helper functions to analyze student code, such as detecting incorrectly closed files, preventing the use of certain operators or literals, checking function signatures, and rudimentary unit testing functionality.
Sandbox
from pedal.sandbox import run
student = run()
result_should_be_6 = student.call('add3', 1, 2, 3)A sophisticated system for executing students’ code under different circumstances. Relies on the exec and patch tools of Python to prevent students from escaping their namespace.
However, you should be aware that true sandboxing is impossible in a dynamic language like Python. Be sure that your environment has multiple lines of defense, such as proper file system permissions.
Resolvers
Simple
from pedal.resolvers import simple
print(simple.resolve())This resolver finds the highest priority message to deliver to the student, depending on a pre-established bit of logic for tools.
Others
Other resolvers are possible - we could find the first, or deliver more than one (grouped using HTML formatting).
Plugins
Plugins can be used to better integration with external environments, or for utility scripts.
VPL
Strips out HTML
Jupyter Notebooks
Grade magic, tools for syncing problem with BlockPy
BlockPy
See BlockPy for more information
Web-CAT
No special connections anymore!
Reference Checks
Unit testing harness for verifying instructor tests produce the expected output when given various student files.
Download files
Download the file for your platform. If you're not sure which to choose, learn more about installing packages.
Source Distribution
Built Distribution
Filter files by name, interpreter, ABI, and platform.
If you're not sure about the file name format, learn more about wheel file names.
Copy a direct link to the current filters
File details
Details for the file Pedal-0.1.6.tar.gz.
File metadata
- Download URL: Pedal-0.1.6.tar.gz
- Upload date:
- Size: 93.0 kB
- Tags: Source
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/36.5.0.post20170921 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.5.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
43172422aa076422e36e2bc87b36801b0f0c79354ff5066879980bc9c5b4b4ff
|
|
| MD5 |
ed722cc38c3af7ac879d35c2b59c2b51
|
|
| BLAKE2b-256 |
20ff47cdd498a08cf7b40d4bdd891a5798aee97611615a06e0ebf7767403b87d
|
File details
Details for the file Pedal-0.1.6-py3-none-any.whl.
File metadata
- Download URL: Pedal-0.1.6-py3-none-any.whl
- Upload date:
- Size: 140.1 kB
- Tags: Python 3
- Uploaded using Trusted Publishing? No
- Uploaded via:
twine/1.11.0 pkginfo/1.4.2 requests/2.18.4 setuptools/36.5.0.post20170921 requests-toolbelt/0.8.0 tqdm/4.28.1 CPython/3.5.4
File hashes
| Algorithm | Hash digest | |
|---|---|---|
| SHA256 |
37814565d75e81489c5b276842bd4afc77825a055c043af6357a108f7afc6fd4
|
|
| MD5 |
6e03d89b4c44613c89fb1f89771b21e3
|
|
| BLAKE2b-256 |
10013440a5d6775b28c97bde7780982b8475ea379fa29bee50cfcde161c31bb5
|
