Glossary · Infrastructure

Edge Inference

Running a model's inference computation on a local device (phone, laptop, IoT device) rather than a remote cloud server, trading some capability for lower latency, offline operation, and data privacy.