立即学习:https://edu.csdn.net/course/play/28807/427188?utm_source=blogtoedu
具体的API使用可以参考:
https://docs.openvinotoolkit.org/latest/index.html
net = ie.read_network(model=model_xml, weights=model_bin)
将网络读入CPU插件中:exec_net = ie.load_network(network=net, device_name='CPU')
得到推理结果的输出:out = exec_net.infer(inputs={input_blob: image})
1) 查看可用设备列表:
使用ie.available_devices使用 print()函数print(ie.available_devices)
['CPU', 'GNA']
2) 使用不同的设备做推理: 举例,如果你有 HDDL...
exec_net = ie.load_network(network=net, device_name='HDDL')
3) 增加性能计数器:
根据上一个实验获取到的可用设备,将其选择为进行实验的设备,添加至“device_name”选项。使用performance_counters = exec_net.requests[0].get_perf_counts() 增加性能计数器python3 classifiction-2.py
Class Probability --------------------------------------------- cheeseburger 0.9797323 beigel 0.0092792 hot dog, red hot 0.0088993 guacamole 0.0011216 Smith 0.0005306 potpie 0.0001503 cuke 0.0001258 cream, icecream 0.0000298 ball 0.0000223 bakeshop, bakehouse 0.0000212
name layer_type exet_type status real_time, us ---------------------------------------------------------------------------------------------------------- conv1 Convolution jit_avx512_FP32 EXECUTED 3184 conv10 Convolution jit_avx512_1x1_FP32 EXECUTED 1474 fire2/concat Concat unknown_FP32 EXECUTED 21 fire2/expand1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 54 fire2/expand3x3 Convolution jit_avx512_FP32 EXECUTED 403 fire2/relu_expand1x1 ReLU undef NOT_RUN 0 fire2/relu_expand3x3 ReLU undef NOT_RUN 0 fire2/relu_squeeze1x1 ReLU undef NOT_RUN 0 fire2/squeeze1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 184 fire3/concat Concat unknown_FP32 EXECUTED 33 fire3/expand1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 76 fire3/expand3x3 Convolution jit_avx512_FP32 EXECUTED 387 fire3/relu_expand1x1 ReLU undef NOT_RUN 0 fire3/relu_expand3x3 ReLU undef NOT_RUN 0 fire3/relu_squeeze1x1 ReLU undef NOT_RUN 0 fire3/squeeze1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 118 fire4/concat Concat unknown_FP32 EXECUTED 25 fire4/expand1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 44 fire4/expand3x3 Convolution jit_avx512_FP32 EXECUTED 390 fire4/relu_expand1x1 ReLU undef NOT_RUN 0 fire4/relu_expand3x3 ReLU undef NOT_RUN 0 fire4/relu_squeeze1x1 ReLU undef NOT_RUN 0 fire4/squeeze1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 76 fire5/concat Concat unknown_FP32 EXECUTED 18 fire5/expand1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 44 fire5/expand3x3 Convolution jit_avx512_FP32 EXECUTED 394 fire5/relu_expand1x1 ReLU undef NOT_RUN 0 fire5/relu_expand3x3 ReLU undef NOT_RUN 0 fire5/relu_squeeze1x1 ReLU undef NOT_RUN 0 fire5/squeeze1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 119 fire6/concat Concat unknown_FP32 EXECUTED 10 fire6/expand1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 31 fire6/expand3x3 Convolution jit_avx512_FP32 EXECUTED 222 fire6/relu_expand1x1 ReLU undef NOT_RUN 0 fire6/relu_expand3x3 ReLU undef NOT_RUN 0 fire6/relu_squeeze1x1 ReLU undef NOT_RUN 0 fire6/squeeze1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 57 fire7/concat Concat unknown_FP32 EXECUTED 2 fire7/expand1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 30 fire7/expand3x3 Convolution jit_avx512_FP32 EXECUTED 321 fire7/relu_expand1x1 ReLU undef NOT_RUN 0 fire7/relu_expand3x3 ReLU undef NOT_RUN 0 fire7/relu_squeeze1x1 ReLU undef NOT_RUN 0 fire7/squeeze1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 55 fire8/concat Concat unknown_FP32 EXECUTED 2 fire8/expand1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 46 fire8/expand3x3 Convolution jit_avx512_FP32 EXECUTED 376 fire8/relu_expand1x1 ReLU undef NOT_RUN 0 fire8/relu_expand3x3 ReLU undef NOT_RUN 0 fire8/relu_squeeze1x1 ReLU undef NOT_RUN 0 fire8/squeeze1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 108 fire9/concat Concat unknown_FP32 EXECUTED 2 fire9/expand1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 54 fire9/expand3x3 Convolution jit_avx512_FP32 EXECUTED 445 fire9/relu_expand1x1 ReLU undef NOT_RUN 0 fire9/relu_expand3x3 ReLU undef NOT_RUN 0 fire9/relu_squeeze1x1 ReLU undef NOT_RUN 0 fire9/squeeze1x1 Convolution jit_avx512_1x1_FP32 EXECUTED 106 out_prob Output unknown_FP32 NOT_RUN 0 pool1 Pooling jit_avx512_FP32 EXECUTED 936 pool10/reduce Pooling jit_avx512_FP32 EXECUTED 35 pool10/reduce_nChw16c_nchw_prob Reorder ref_any_FP32 EXECUTED 72 pool3 Pooling jit_avx512_FP32 EXECUTED 91 pool5 Pooling jit_avx512_FP32 EXECUTED 58 prob SoftMax jit_avx512_FP32 EXECUTED 21 relu_conv1 ReLU undef NOT_RUN 0 relu_conv10 ReLU undef NOT_RUN 0