Glossary · Technology

Screen Understanding

A model's capability to interpret a screenshot or live screen state — identifying buttons, text fields, and layout — well enough to decide where to click or what to type next.