Troubleshooting

Memory management

Too many images in the processing queue might cause out-of-memory error and terminate the SDK without error. Calling get_result will remove the image from the queue and thus reduce the memory consumption.

Multiprocessing

In certain cases, e.g. using Cloud instances, the machine might become unresponsive, if more compute resources are used than specified. Each of Plugins have their own way to configure multiprocessing.

For ONNX CPU plugin, you can set the number of intra and outer threads.