text-generation-inference documentation
Using TGI with Inferentia
Using TGI with Inferentia
You can use TGI on AWS Trainium and Inferentia platforms using the TGI neuron backend.
<>Update on GitHubtext-generation-inference documentation
Using TGI with Inferentia
You can use TGI on AWS Trainium and Inferentia platforms using the TGI neuron backend.
<>Update on GitHub