A high-throughput and memory-efficient inference and serving engine for LLMs
amd cuda inference pytorch transformer llama gpt rocm model-serving tpu hpu mlops xpu llm inferentia llmops llm-serving qwen deepseek trainium
- Updated
Jun 27, 2025 - Python
#
hpu
Here are 7 public repositories matching this topic...
Easy and lightning fast training of 🤗 Transformers on Habana Gaudi processor (HPU)
- Updated
Jun 27, 2025 - Python
Computer vision for tuberculosis classification and lung segmentation.
- Updated
Feb 18, 2022 - Jupyter Notebook
Improve this page
Add a description, image, and links to the hpu topic page so that developers can more easily learn about it.
Add this topic to your repo
To associate your repository with the hpu topic, visit your repo's landing page and select "manage topics."