# TGI (Text Generation Inference)

URL: https://donedeploy.com/technologies/tgi/

[!AI · November 2, 2026CI/CD for Models and PromptsEvaluation gates, model registries, canary releases and rollback: applying CI/CD discipline to prompts and models in LLM applications.](https://donedeploy.com/cicd-for-llms/)[!AI · October 23, 2026Fine-Tuning or Prompting? A Decision Guide for Small TeamsWhen prompting, RAG or fine-tuning is the right way to adapt a language model, and what each one costs a small engineering team.](https://donedeploy.com/fine-tuning-or-prompting/)

Questions

## TGI (Text Generation Inference): frequently asked

Should we choose TGI or vLLM?

Both serve open models with batching and an HTTP API. For new projects vLLM usually has wider community activity; check TGI's current status and benchmark both on your model.

Can TGI serve any Hugging Face model?

It supports many popular text generation architectures, but not every model. Check the supported models list for your model first.

Running TGI (Text Generation Inference), or deciding whether to? Tell us what you have; the first consultation is free.

[Let's talk »](https://donedeploy.com/lets-talk/)