sagemaker-mxnet-training 4.3.0

Open source library for creating MXNet containers to run on Amazon SageMaker.

SageMaker MXNet Training Toolkit is an open-source library for using MXNet to train models on Amazon SageMaker. For inference, see SageMaker MXNet Inference Toolkit. For the Dockerfiles used for building SageMaker MXNet Containers, see AWS Deep Learning Containers. For information on running MXNet jobs on Amazon SageMaker, please refer to the SageMaker Python SDK documentation.

Contributing

Please read CONTRIBUTING.md for details on our code of conduct, and the process for submitting pull requests to us.

Testing

Set up a virtual environment for testing.

One of the multiple ways to setup a virtual environment

# use a package virtualenv
# create a virtualenv
virtualenv -p python3 <name of env>
# activate the virtualenv
source <name of env>/bin/activate

Install requirements

pip install --upgrade .[test]

Local Test

To run specific test

tox -- -k test/unit/test_training.py::test_train_for_distributed_scheduler

To run an entire file

tox -- test/unit/test_training.py

To run all tests within a folder [e.g. integration/local/]

Note: To run integration tests locally, one needs to build an image. To trigger image build, use -B flag.

tox -- test/integration/local

You can also run them in parallel:

tox -- -n auto test/integration/local

To run for specific interpreter [Python environment], use the -e flag

tox -e py37 -- test/unit/test_training.py

Remote Test

Make sure to provide AWS account ID, Region, Docker base name & Tag. Docker Registry is composed of (aws_id, region) Image URI is composed of (docker_registry, docker_base_name, tag)

Resulting Image URI is composed as: {aws_id}.dkr.ecr.{region}.amazonaws.com/{docker_base_name}:{tag}

tox -- --aws-id <aws_id> --region <region> --docker-base-name <docker_base_name> --tag <tag> test/integration/sagemaker

For more details, refer conftest.py

License

SageMaker MXNet Training Toolkit is licensed under the Apache 2.0 License. It is copyright 2018 Amazon.com, Inc. or its affiliates. All Rights Reserved. The license is available at: http://aws.amazon.com/apache2.0/