Glossary · Infrastructure

Model Serving

The infrastructure and software layer responsible for running a trained model in production and responding to inference requests reliably at scale.