Skip to main content

A python tool to distributively run GCJ/FB hacker cup testcases on several machines.

Project description

A python tool to distributively run GCJ/FB hacker cup testcases on several machines.

How does it work

  • First the splitter runs on the input file to split it into seprate test cases.

  • Test cases with the actuall code are sent to the server.

  • The server distributes the test cases and the actuall code to its registered nodes.

  • Each node computes the result for its testcases and sends the result back to the server

  • The server collects the results and sort them by their testcase number and sends them back to the calling script.

Installation

pip install dTests

Running dTests

  • Create new project:

    dtests_job new project_name language
  • The only supported languages now are “cpp” and “java”.

  • Open the new folder and code your splitter to read from the input.in file.

  • Between each test cases print “–split–\n”. The split marker can be configured in “config.json” file. This will split the input file into single test cases which will be distributed on the machines running.

  • Code your program file to read from stdin as if it is reading a single test cases.

  • Run the server

    dtests_server
  • Run one or many nodes on other machines ( or for testing on the same machine ):

    dtests_node --host host --port port
  • Finally run the job:

    dtests_job run
  • Check the help of these commands for further customizations

Sample project

This is a sample cpp project that takes input and multiply it by itself https://github.com/MohamedBassem/dTests/tree/master/samples/power2

  • The config.json file contains the project configuration. The language and the splitter syntax.

  • The splitter.cpp file contains the code that reads the input from the “input.in” file and splits it to single test cases.

  • The program.cpp file that reads a single test cases from stdin and computes the result.

  • To Run this project, run the server and at least one node. Then run “dtests_job run” in the project’s directory.

TODO

  • Finding a way to pass the testcase number to the program

  • Writing Tests.

  • Making the system fault tolerant.

  • Finding a better way for splitting the input file.

  • Supporting more programming languages.

For more info visit https://github.com/MohamedBassem/dTests

Contributing

Your contributions ( Ideas, improvments, etc.. ) are more than welcome.

LICENSE

Licensed under the MIT license.

Project details


Download files

Download the file for your platform. If you're not sure which to choose, learn more about installing packages.

Source Distribution

dTests-0.1.7.tar.gz (6.8 kB view details)

Uploaded Source

File details

Details for the file dTests-0.1.7.tar.gz.

File metadata

  • Download URL: dTests-0.1.7.tar.gz
  • Upload date:
  • Size: 6.8 kB
  • Tags: Source
  • Uploaded using Trusted Publishing? No

File hashes

Hashes for dTests-0.1.7.tar.gz
Algorithm Hash digest
SHA256 0c7326c8e06316ae65ec6f160281a7c0fdfbd05e7fe5e2ee5aa4a2e5523c5d51
MD5 527a86d3a5dccea04cb53b1371bb5642
BLAKE2b-256 ef0097d567fb99a7c4900f1e0c90bd022001302c407ae89d834c48aa8a714c0d

See more details on using hashes here.

Supported by

AWS Cloud computing and Security Sponsor Datadog Monitoring Fastly CDN Google Download Analytics Pingdom Monitoring Sentry Error logging StatusPage Status page