Skip to main content

A python tool to distributively run GCJ/FB hacker cup testcases on several machines.

Project description

A python tool to distributively run GCJ/FB hacker cup testcases on several machines.

How does it work

  • First the splitter runs on the input file to split it into seprate test cases.

  • Test cases with the actuall code is sent to the server.

  • The server distributes the test cases and the actuall code to its registered nodes.

  • Each node computes the result for its testcases and sends the result back to the server

  • The server collects the results and sort them by their testcase number and sends them back to the calling script.

Installation

pip install dTests

Running dTests

  • Create new project:

    dtests_job.py new project_name language
  • The only supported languages now are “cpp” and “java”.

  • Open the new folder and code your splitter to read from the input.in file.

  • Between each test cases print “–split–n”. The split marker can be configured in “config.json” file. This will split the input file into single test cases which will be distributed on the machines running.

  • Code your program file to read from stdin as if it is reading a single test cases.

  • Run the server

    dtests_server.py
  • Run one or many nodes on other machines ( or for testing on the same machine ):

    dtests_node.py --host host --port port
  • Finally run the job:

    dtests_job.py run
  • Check the help of these commands for further customizations

TODO

  • Finding a way to pass the testcase number to the program

  • Writing Tests.

  • Making the system fault tolerant.

  • Finding a better way for splitting the input file.

  • Supporting more programming languages.

For more info visit https://github.com/MohamedBassem/dTests

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dTests-0.1.3.tar.gz (6.0 kB view hashes)

Uploaded source

Supported by

AWS AWS Cloud computing Datadog Datadog Monitoring Facebook / Instagram Facebook / Instagram PSF Sponsor Fastly Fastly CDN Google Google Object Storage and Download Analytics Huawei Huawei PSF Sponsor Microsoft Microsoft PSF Sponsor NVIDIA NVIDIA PSF Sponsor Pingdom Pingdom Monitoring Salesforce Salesforce PSF Sponsor Sentry Sentry Error logging StatusPage StatusPage Status page