neural_compressor.profiling.profiler.onnxrt_profiler.utils

ONNX profiler utils.

Functions

create_onnx_config(→ Any)

Create tensorflow config.

Module Contents

neural_compressor.profiling.profiler.onnxrt_profiler.utils.create_onnx_config(ort: Any, intra_num_of_threads: int, inter_num_of_threads: int) → Any[source]

Create tensorflow config.

Parameters:

  • ort – onnxruntime library

  • intra_num_of_threads – number of threads used within an individual op for parallelism

  • inter_num_of_threads – number of threads used for parallelism between independent operations

Returns:

ONNX SessionOptions object