Search Results for author:
Found 9 papers, 5 papers with code
On the Effects of Data Scale on Computer Control Agents
Moreover, AndroidControl is the most diverse computer control dataset to date, including 15, 283 unique tasks over 833 Android apps, thus allowing us to conduct in-depth analysis of the model performance in and out of the domain of the training data.
AndroidWorld: A Dynamic Benchmarking Environment for Autonomous Agents
Finally, we conduct a robustness analysis by testing M3A against a range of task variations on a representative subset of tasks, demonstrating that variations in task parameters can significantly alter the complexity of a task and therefore an agent's performance, highlighting the importance of testing agents under diverse conditions.
Dissociation of Faithful and Unfaithful Reasoning in LLMs
We identify factors that shift LLM recovery behavior: LLMs recover more frequently from obvious errors and in contexts that provide more evidence for the correct answer.
Generative AI Search Engines as Arbiters of Public Knowledge: An Audit of Bias and Authority
This paper reports on an audit study of generative AI systems (ChatGPT, Bing Chat, and Perplexity) which investigates how these new search engines construct responses and establish authority for topics of public importance.
Latent State Estimation Helps UI Agents to Reason
In the context of autonomous UI agents we then show that LLMs used in this manner are more than $76\%$ accurate at inferring various aspects of latent state, such as performed (vs. commanded) actions and task progression.
Android in the Wild: A Large-Scale Dataset for Android Device Control
The dataset contains human demonstrations of device interactions, including the screens and actions, and corresponding natural language instructions.
The 7th AI City Challenge
The AI City Challenge's seventh edition emphasizes two domains at the intersection of computer vision and artificial intelligence - retail business and Intelligent Traffic Systems (ITS) - that have considerable untapped potential.
Productivity Assessment of Neural Code Completion
Neural code synthesis has reached a point where snippet generation is accurate enough to be considered for integration into human software development workflows.
The 6th AI City Challenge
The four challenge tracks of the 2022 AI City Challenge received participation requests from 254 teams across 27 countries.
