❓ [Question] How to convert Torch-TensorRT module to TRT engine?

[lingffff]

❓ Question

How to convert Torch-TensorRT module (*.ts) to TRT engine? Is there any Python API to do that?

What you have already tried

In examples, I found

auto engine = torch_tensorrt::ts::convert_method_to_trt_engine(mod, "forward", compile_spec);

in https://github.com/pytorch/TensorRT/blob/master/examples/int8/qat/main.cpp

If this is the correct way to do converting? If yes, is there any Python API?

Environment

amd64 + Linux
all software is newest version

Additional context

[narendasan]

Yes this is the way, there is a python api by the same name in torch_tensorrt.ts

[YHRen]

Thanks a lot. I'd suggest to include a short example in the documentation.