kaggle_runner
Check main.py or test/test_coord.py for usage. It uses kaggle API to upload your script/notebook to kaggle servers and let the kernel run. And you will get running logs through message queue.
AMQP
AMQP is used for logging. Its license needs mention.
Example
Use this kaggle competition about Pneumothorax Segmentation as an example. To run the example, you will need a kaggle account and set the kaggle command line tool up. And you issues this command to let it run:
# install kaggle_runner, which will pull kaggle command line tool as the dependency
pip install kaggle_runner
# put your kaggle API token to the right place
cat > ~/.kaggle/kaggle.json <<EOF
{
"username": "YOUR_KAGGLE_USER_NAME",
"key": "YOUR_KAGGLE_API_ACCESS_TOKEN",
}
EOF
# kaggle_runner will use kaggle API to push the template kernel codes to kaggle server and wait message back
python -m kaggle_runner
A demo:
- #0 Left panel: tcpserver listen for reverse shells
- #1 Upper panel: Logs from interactive session to our tcpserver which receive logs
- #2 Second upper panel: AMQP logs received
- #3 Main panel: vim window
- #4 Right bottom panel: logged in reverse shell for commit session
Metadata
Release files for kaggle-runner 0.2.1
For a detailed explanation of source distributions (sdists) and built distributions (wheels), please see the package formats documentation.
Source distribution (sdist)
| File | Size | Uploaded | |
|---|---|---|---|
| kaggle-runner-0.2.1.tar.gz | 688.1 kB | Details |
Built distribution (wheel)
| File | Interpreter | ABI | Platform | Reset |
|---|---|---|---|---|
| kaggle_runner-0.2.1-py3-none-any.whl | Python 3 | none | any | Details |
Total release size: 896.1 kB
Release files / kaggle-runner-0.2.1.tar.gz
| Download URL | kaggle-runner-0.2.1.tar.gz |
|---|---|
| Size | 688.1 kB |
| Tags | Source |
|
SHA-256 checksum How to use checksums |
3772423239e262535f81a0bee1e1ce6c8f4205ce36883e46a0ed38620cfc69e8
|
|
BLAKE2b-256 checksum How to use checksums |
810fc117f1bd79c05f401c42ec56385ff0f73f767d8de8175d43b4c5659a86de
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.2.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.7.3
|
Release files / kaggle_runner-0.2.1-py3-none-any.whl
| Download URL | kaggle_runner-0.2.1-py3-none-any.whl |
|---|---|
| Size | 208.1 kB |
| Tags | Python 3 |
|
SHA-256 checksum How to use checksums |
66d74af2f6e2676be7ff4206df6ba36c84adad42c96219c0e318082ef534519f
|
|
BLAKE2b-256 checksum How to use checksums |
b1f12bb9257d1acd600040fe0cc5ac849aa190f567223ed4a838888ac3bc0cf5
|
| Upload date | |
|
Uploaded using Trusted Publishing? What is trusted publishing? |
No |
| Uploaded via |
twine/3.1.1 pkginfo/1.5.0.1 requests/2.23.0 setuptools/46.2.0 requests-toolbelt/0.9.1 tqdm/4.43.0 CPython/3.7.3
|