discussions Search Results · repo:pytorch/TensorRT language:Python
Filter by
124 results
(81 ms)124 results
inpytorch/TensorRT (press backspace or delete to remove):
PyTorch 2.7, CUDA 12.8, TensorRT 10.9, Python 3.13 Torch-TensorRT 2.7.0 targets PyTorch 2.7, TensorRT 10.9, and CUDA 12.8, (builds for CUDA 11.8/12.4 are available via the PyTorch package index - https://download.pytorch.org/whl/cu118 ...
narendasanposted
on May 7- 0
:
Complex number handling in Torch-TensorRT TL;DR This RFC proposes the addition of complex number support in Torch-TensorRT. TensorRT does not support complex numbers, but with the use of rotary embeddings ...
apboseposted
on Apr 1- 8
:
Can I use autograd.grad with torch-tensorrt? We pass the coordinates of the atoms to the model, calculate the potential energy, and then differentiate the potential energy by pos to calculate the force. ...
kudoryutaroposted
on Jun 13, 2023- 4
:
TL;DR We want to automatically generate the plugin and converters given the kernel and host code. Users can include a custom kernel in a TensorRT engine using Torch-TensorRT and users don t need to write ...
bowang007posted
on Oct 1, 2024- 4
:
Multi GPU compilation support TL;DR An important use case for Torch-TRT is to support multi-GPU and multi-node. The goal is to boost the performance using data parallelism and tensor parallelism to compile ...
- on Aug 7, 2024
- 4
:
I am trying to compile a CLIP text encoder model using: pipe.text_encoder = torch_tensorrt.compile( pipe.text_encoder, ir= dynamo , inputs=[torch.zeros(1, 77, dtype=torch.int32, device= cuda ...
derMartposted
on Jan 23- 5
:
TL;DR We want to use AOTInductor to compile and package Torch-TensorRT compiled modules to produce shared object files which can be used in Pythonless deployment. This could be especially beneficial for ...
peri044posted
on Nov 19, 2024- 3
:
I read the code and i think both functions are the same! First, both them get supported op from same path, although using different logic. I think they can use unify function, now they are redundant code. ...
gavin838posted
on Dec 16, 2024- 2
:
TL;DR TensorRT 8.5 supports dynamically shaped output feature, this helps support cases that shapes depend on input data. We should integrate this new feature. Goal(s) Allow users to use data dependent ...
- on Feb 28, 2023
- 4
:
Building Refittable Engines by Default TL;DR !-- Summarize the feature being proposed here -- Build engines which can have their weights changed after build time by default vs. current behavior today. ...
- on Oct 2, 2024
- 7