Skip to main content

A framework that takes care of boundary tasks to ease task evaluations and make them faster.

Project description

GradeFast-2019

'Gradefast Logo'

Gradefast is a framework whose intention is to make eYRC evaluations faster and bring a standardization across task evaluations. Most important benefit is that the test scripts can then be extended and be reused in other themes having similar tasks. Primary thought behind making GradeFast is to take care of all the boundary tasks that happen in theme evaluations and also make utility scripts that take care of other common tasks so that a lot of time is saved. Some of these tasks are downloading new submissions, iterating over each of the submission folders, easily finding files to test, comments based on criterias, uploading marks and plagiarism checking. The framework is also easy to use causing less to no cognitive load on a theme developer using it.

Installing gradefast

Installing from pip

$ pip install gradefast

OR

Installing from sources

  1. $ git clone https://github.com/eyantra-eysip/GradeFast-2019
  2. $ cd GradeFast-2019
  3. $ git checkout develop
  4. $ pip install .

Creating a gradefast project

Do this once

  1. npm install -g yo
  2. npm install -g generator-gradefast

Then generate your new project like this

yo gradefast

Features

  1. Submission downloading
  2. Plagiarism checking
  3. Primarily built for python but can support evaluation of any other tasks
  4. Aggregate results
  5. Upload marks
  6. Add comments

Also includes

  1. Detailed error logging
  2. Timing and static code analysis of scripts
  3. Resume tasks from where they are stopped
  4. Checking test conventions
  5. Boilerplate code generation

Running tests

  1. For unit tests: python -m unittest discover -s tests/unit/
  2. For integration tests: python -m unittest discover -s tests/unit/

Checking coverage

  1. Install coverage.py: pip install coverage
  2. Run coverage run --source=gradefast/ -m unittest discover -s tests/unit/ or coverage run --source=gradefast/ -m unittest discover -s tests/integration/
  3. Generate static html coverage html
  4. cd htmlcov and run http server with live-server or python3 -m http.server

Building and running documentation

Installing required packages

  1. $ pip install sphinx_ustack_theme or pip install sphinx_rtd_theme
  2. $ pip install --upgrade sphinx

Building docs

  1. $ cd docs
  2. $ make html

Running web server to host documentation

  1. $ cd docs/_build/html

  2. Start a web server in this directory. You can use either the python 3 HTTP server or live-server.

    $ python3 -m http.server

Future work

  • [ ] Statistics and analysis of results
  • [ ] Sandboxed environments
  • [ ] Multi-programming

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Files for gradefast, version 0.1.15
Filename, size File type Python version Upload date Hashes
Filename, size gradefast-0.1.15-py2.py3-none-any.whl (38.8 kB) File type Wheel Python version py2.py3 Upload date Hashes View hashes
Filename, size gradefast-0.1.15.tar.gz (34.7 kB) File type Source Python version None Upload date Hashes View hashes

Supported by

Elastic Elastic Search Pingdom Pingdom Monitoring Google Google BigQuery Sentry Sentry Error logging AWS AWS Cloud computing DataDog DataDog Monitoring Fastly Fastly CDN DigiCert DigiCert EV certificate StatusPage StatusPage Status page