netspresso-inference-package 0.1.0

Inference module.

How to use

Use directly

• model_file_path: Model file path(ONNX, TFLite)
• dataset_file_path: The path to the compressed file or the individual npy files where the delimiter of the input layer is used as the file name.

python3 inference.py --model_file_path tests/your_model_file.tflite --dataset_file_path tests/your_dataset_file.npy 

Import and use

from netspresso_inference_package.inference.inference_service import InferenceService
inf_service = InferenceService(
        model_file_path="/app/tests/people_detection.onnx",
        dataset_file_path="/app/tests/dataset_for_onnx.npy"
        )
inf_service.run()
print(inf_service.result_file_path)