Device Query Hello World + MYRIAD plugin =)

[raymondlo84]

I think this would be useful for people who want to run the Neural Compute Stick 2 (NCS2) with the Notebooks. You basically make a simple toggle here...

If you look at the Hello World Notebook here:

https://github.com/openvinotoolkit/openvino_notebooks/blob/main/notebooks/001-hello-world/001-hello-world.ipynb

exec_net = ie.load_network(net, "MYRIAD")
vs

exec_net = ie.load_network(net, "CPU")

https://docs.openvinotoolkit.org/latest/openvino_docs_IE_DG_Deep_Learning_Inference_Engine_DevGuide.html

And you can also run this device query code to make sure MYRIAD X plugin is properly enabled. You should be able to see that after you plugin your NCS2!

import sys
from openvino.inference_engine import IECore

def param_to_string(metric):
    if isinstance(metric, (list, tuple)):
        return ", ".join([str(val) for val in metric])
    elif isinstance(metric, dict):
        str_param_repr = ""
        for k, v in metric.items():
            str_param_repr += "{}: {}\n".format(k, v)
        return str_param_repr
    else:
        return str(metric)

ie = IECore()
print("Available devices:")
for device in ie.available_devices:
    print("\tDevice: {}".format(device))
    print("\tMetrics:")
    for metric in ie.get_metric(device, "SUPPORTED_METRICS"):
        try:
          metric_val = ie.get_metric(device, metric)
          print("\t\t{}: {}".format(metric, param_to_string(metric_val)))
        except TypeError:
          print("\t\t{}: UNSUPPORTED TYPE".format(metric))

    print("\n\tDefault values for device configuration keys:")
    for cfg in ie.get_metric(device, "SUPPORTED_CONFIG_KEYS"):
        try:
          cfg_val = ie.get_config(device, cfg)
          print("\t\t{}: {}".format(cfg, param_to_string(cfg_val)))
        except TypeError:
          print("\t\t{}: UNSUPPORTED TYPE".format(cfg))

And you will get an output like this

Available devices:
	Device: CPU
	Metrics:
		AVAILABLE_DEVICES: 
		SUPPORTED_METRICS: AVAILABLE_DEVICES, SUPPORTED_METRICS, FULL_DEVICE_NAME, OPTIMIZATION_CAPABILITIES, SUPPORTED_CONFIG_KEYS, RANGE_FOR_ASYNC_INFER_REQUESTS, RANGE_FOR_STREAMS
		FULL_DEVICE_NAME: Intel(R) Core(TM) i9-9880H CPU @ 2.30GHz
		OPTIMIZATION_CAPABILITIES: FP32, FP16, INT8, BIN
		SUPPORTED_CONFIG_KEYS: CPU_BIND_THREAD, CPU_THREADS_NUM, CPU_THROUGHPUT_STREAMS, DUMP_EXEC_GRAPH_AS_DOT, DYN_BATCH_ENABLED, DYN_BATCH_LIMIT, ENFORCE_BF16, EXCLUSIVE_ASYNC_REQUESTS, PERF_COUNT
		RANGE_FOR_ASYNC_INFER_REQUESTS: 1, 1, 1
		RANGE_FOR_STREAMS: 1, 16

	Default values for device configuration keys:
		CPU_BIND_THREAD: NUMA
		CPU_THREADS_NUM: 0
		CPU_THROUGHPUT_STREAMS: 1
		DUMP_EXEC_GRAPH_AS_DOT: 
		DYN_BATCH_ENABLED: NO
		DYN_BATCH_LIMIT: 0
		ENFORCE_BF16: NO
		EXCLUSIVE_ASYNC_REQUESTS: NO
		PERF_COUNT: NO
	Device: MYRIAD
	Metrics:
		DEVICE_THERMAL: UNSUPPORTED TYPE
		SUPPORTED_CONFIG_KEYS: DEVICE_ID, PERF_COUNT, EXCLUSIVE_ASYNC_REQUESTS, VPU_MYRIAD_PLATFORM, CONFIG_FILE, VPU_PRINT_RECEIVE_TENSOR_TIME, VPU_CUSTOM_LAYERS, MYRIAD_THROUGHPUT_STREAMS, VPU_HW_STAGES_OPTIMIZATION, MYRIAD_ENABLE_FORCE_RESET, LOG_LEVEL, VPU_MYRIAD_FORCE_RESET, MYRIAD_CUSTOM_LAYERS, MYRIAD_ENABLE_RECEIVING_TENSOR_TIME, MYRIAD_ENABLE_HW_ACCELERATION
		RANGE_FOR_ASYNC_INFER_REQUESTS: 3, 6, 1
		OPTIMIZATION_CAPABILITIES: FP16
		SUPPORTED_METRICS: DEVICE_THERMAL, SUPPORTED_CONFIG_KEYS, RANGE_FOR_ASYNC_INFER_REQUESTS, OPTIMIZATION_CAPABILITIES, SUPPORTED_METRICS, FULL_DEVICE_NAME, AVAILABLE_DEVICES
		FULL_DEVICE_NAME: Intel Movidius Myriad X VPU
		AVAILABLE_DEVICES: 20.2.3-ma2480

	Default values for device configuration keys:
		DEVICE_ID: 
		PERF_COUNT: NO
		EXCLUSIVE_ASYNC_REQUESTS: NO
		VPU_MYRIAD_PLATFORM: 
		CONFIG_FILE: 
		VPU_PRINT_RECEIVE_TENSOR_TIME: NO
		VPU_CUSTOM_LAYERS: 
		MYRIAD_THROUGHPUT_STREAMS: -1
		VPU_HW_STAGES_OPTIMIZATION: YES
		MYRIAD_ENABLE_FORCE_RESET: NO
		LOG_LEVEL: LOG_NONE
		VPU_MYRIAD_FORCE_RESET: NO
		MYRIAD_CUSTOM_LAYERS: 
		MYRIAD_ENABLE_RECEIVING_TENSOR_TIME: NO
		MYRIAD_ENABLE_HW_ACCELERATION: YES

[raymondlo84]

And you can see it can run at 60+fps - and that's pretty neat.