Glossary · Infrastructure

Multi-Tenant Inference

Serving multiple customers' requests on shared model-serving infrastructure, a common cost-efficiency practice that raises data-isolation questions worth confirming with a vendor for sensitive workloads.