Probing Large Language Models for Scalar Adjective Lexical Semantics and Scalar Diversity Pragmatics

1 code implementation • 4 Apr 2024 • Fangru Lin, Daniel Altshuler, Janet B. Pierrehumbert

In this study, we probe different families of Large Language Models such as GPT-4 for their knowledge of the lexical semantics of scalar adjectives and one specific aspect of their pragmatics, namely scalar diversity.

Implicatures

Graph-enhanced Large Language Models in Asynchronous Plan Reasoning

1 code implementation • 5 Feb 2024 • Fangru Lin, Emanuele La Malfa, Valentin Hofmann, Elle Michelle Yang, Anthony Cohn, Janet B. Pierrehumbert

Planning is a fundamental property of human intelligence.

Code Simulation Challenges for Large Language Models

1 code implementation • 17 Jan 2024 • Emanuele La Malfa, Christoph Weinhuber, Orazio Torre, Fangru Lin, Samuele Marro, Anthony Cohn, Nigel Shadbolt, Michael Wooldridge

We propose a novel off-the-shelf prompting method, Chain of Simulation (CoSm), which instructs LLMs to simulate code execution line by line/follow the computation pattern of compilers.