Discussions

• 0 You must be logged in to vote

  #️⃣

  torch2trt converters to bootstrap FX converter library

  WIP Work is in progress, pull request should not be merged yet RFC: Committed This RFC has been committed to be implemented

  apbose started Dec 16, 2022 in RFCs

  

  

  

  

  6
• 1 You must be logged in to vote

  #️⃣

  Torch-TensorRT Backend for torch.compile

  RFC: Under Review This RFC is under review

  narendasan started Feb 21, 2023 in RFCs

  

  

  1
• 1 You must be logged in to vote

  🙏

  TensorRT 8.5.2 support?

  HugeBob asked Feb 9, 2023 in Q&A · Unanswered

  

  

  

  

  10
• 1 You must be logged in to vote

  #️⃣

  aten::size with dynamic shapes handling

  RFC: Needs Scoping

  peri044 started Jan 6, 2023 in RFCs

  

  

  

  

  3
• 1 You must be logged in to vote

  #️⃣

  Integration of FX and TS shared components

  release: v1.3 Tagged to be included in v1.3 RFC: Committed This RFC has been committed to be implemented

  narendasan started Sep 23, 2022 in RFCs

  

  

  

  

  10
• 1 You must be logged in to vote

  #️⃣

  Support Pytorch quantization toolkit based QAT sample using FX backend of Torch-TRT

  peri044 started Feb 14, 2023 in RFCs

  

  

  2
• 1 You must be logged in to vote

  #️⃣

  PTQ Calibration in FX

  RFC: Under Review This RFC is under review

  peri044 started Feb 14, 2023 in RFCs

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  Collection IO

  RFC: Implemented This RFC has been implemented

  narendasan started Sep 18, 2021 in RFCs

  

  

  

  

  18
• 2 You must be logged in to vote

  #️⃣

  TensorRT Plugins in FX

  RFC: Under Review This RFC is under review

  narendasan started Jan 13, 2023 in RFCs

  

  

  3
• 1 You must be logged in to vote

  #️⃣

  Performance Benchmarking, Testing, and Evaluation

  RFC: Under Review This RFC is under review

  gs-olive started Dec 16, 2022 in RFCs

  

  

  

  

  4
• 2 You must be logged in to vote

  #️⃣

  Dynamic shapes + fallback

  component: partitioning RFC: Implemented This RFC has been implemented

  peri044 started Sep 23, 2022 in RFCs

  

  

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Automatic int32 <=> int64 datatype conversion in fallback

  RFC: Implemented This RFC has been implemented

  bowang007 started Oct 3, 2022 in RFCs

  

  

  

  

  5
• 2 You must be logged in to vote

  #️⃣

  Converter Versioning and Capability Declaration

  RFC: Committed This RFC has been committed to be implemented

  narendasan started Jun 17, 2022 in RFCs

  

  

  5
• 2 You must be logged in to vote

  #️⃣

  Dry-Run Flow RFC

  RFC: Under Review This RFC is under review

  mfeliz-cruise started Sep 23, 2022 in RFCs

  

  

  2
• 1 You must be logged in to vote

  #️⃣

  ✨[Feature] Add the ability to set breakpoints in the compilation process.

  feature request New feature or request component: conversion Issues re: Conversion stage component: partitioning RFC: Under Review This RFC is under review

  narendasan started Aug 12, 2022 in RFCs

  

  

  5
• 1 You must be logged in to vote

  #️⃣

  Efficient Casting and Data-Type Tracking Through Torch-TRT Engines

  RFC: Implemented This RFC has been implemented

  gs-olive started Dec 15, 2022 in RFCs

  

  

  4
• 1 You must be logged in to vote

  #️⃣

  Supporting In-Place Operations on Constant Tensors in Torch-TRT

  RFC: Under Review This RFC is under review

  gs-olive started Nov 23, 2022 in RFCs

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  Range Argument for Input Class

  RFC: Implemented This RFC has been implemented

  gs-olive started Oct 28, 2022 in RFCs

  

  

  

  

  6
• 1 You must be logged in to vote

  #️⃣

  Exploration path for Torch-TensorRT integration with PT2.0 tracer

  frank-wei started Jan 11, 2023 in RFCs

  

  

  2
• 1 You must be logged in to vote

  #️⃣

  Using TorchScript Converters in the FX Frontend

  WIP Work is in progress, pull request should not be merged yet

  narendasan started Dec 12, 2022 in RFCs

  

  

  1
• 1 You must be logged in to vote

  🙌

  Torch-TensorRT v1.3.0

  narendasan started Dec 1, 2022 in Show and tell

  

  

  0
• 2 You must be logged in to vote

  🙏

  ❓ [Question] How to convert Torch-TensorRT module to TRT engine?

  question Further information is requested

  lingffff asked May 17, 2022 in Q&A · Answered

  

  

  

  

  2
• 2 You must be logged in to vote

  #️⃣

  Addressing CUDA/CPU Device Errors Occurring Internally in Torch-TRT Compilations

  RFC: Implemented This RFC has been implemented

  gs-olive started Oct 27, 2022 in RFCs

  

  

  0
• 1 You must be logged in to vote

  ⚙️

  Platform Support & Testing Strategy

  component: tests Issues re: Tests platform: x86_64 Bugs regarding the x86_64 builds of TRTorch platform: aarch64 Bugs regarding the x86_64 builds of TRTorch channel: windows bugs, questions, & RFEs around Windows channel: linux-jetpack channel: linux-sbsa channel: linux-x86

  ncomly-nvidia started Jul 14, 2022 in Internals

  

  

  1
• 1 You must be logged in to vote

  #️⃣

  Performance Testing Strategy

  component: tests Issues re: Tests performance

  ncomly-nvidia started Jul 8, 2022 in RFCs

  

  

  

  

  10