Gabriel Schubiner

ActionBert: Leveraging User Actions for Semantic Understanding of User Interfaces

2020 · arXiv (Cornell University)

As mobile devices are becoming ubiquitous, regularly interacting with a variety of user interfaces (UIs) is a common aspect of daily life for many people. To improve the accessibility of these devices and to enable …