fast), cost per token at scale (throughput), or lowest cost (minimal). A deployment created from a shape starts from a configuration that is known to work for that model.
Why deployments created without a shape often fail
If you create a deployment without a shape — that is, without passing--deployment-shape (or deploymentShape in the API) — the configuration is not validated ahead of time. Mistakes only surface at creation, where they cause failures. Common examples:
- A GPU count that cannot fit the model in memory
- An accelerator type the model isn’t validated on (for example, requesting H200 for a model whose shapes are all B200)
- A context length the configuration can’t serve
- A quantization or precision the model doesn’t support on that hardware
How to find and use a shape
The shape list is also the authoritative way to discover which GPU types, GPU counts, and precisions a model supports — a hardware combination with no shape is not a validated configuration.- firectl
- REST API
- Web UI
Match the shapes available for your model:Then pass the shape’s name to
--deployment-shape when creating the deployment: