Sphinx, a multi-dimensional UI-navigation benchmark, shows current foundation models score low on goal understanding, planning, grounding, instruction following, and end-to-end success, with zero successes on industrial WeChat testing tasks.
Title resolution pending
1 Pith paper cite this work. Polarity classification is still indexing.
1
Pith paper citing it
fields
cs.SE 1years
2025 1verdicts
CONDITIONAL 1representative citing papers
citing papers explorer
-
Beyond Pass or Fail: Multi-Dimensional Benchmarking of Foundation Models for Goal-based Mobile UI Navigation
Sphinx, a multi-dimensional UI-navigation benchmark, shows current foundation models score low on goal understanding, planning, grounding, instruction following, and end-to-end success, with zero successes on industrial WeChat testing tasks.