Language in Vivo vs. in Silico: Size Matters but Larger Language Models Still Do Not Comprehend Language on a Par with Humans

no code implementations • 23 Apr 2024 • Vittoria Dentella, Fritz Guenther, Evelina Leivada

LLM performance in some language tasks presents both quantitative and qualitative differences from that of humans, however it remains to be determined whether such differences are amenable to model size.

The Quo Vadis of the Relationship between Language and Large Language Models

no code implementations • 17 Oct 2023 • Evelina Leivada, Vittoria Dentella, Elliot Murphy

In the field of Artificial (General) Intelligence (AI), the several recent advancements in Natural language processing (NLP) activities relying on Large Language Models (LLMs) have come to encourage the adoption of LLMs as scientific models of language.

Testing AI performance on less frequent aspects of language reveals insensitivity to underlying meaning

no code implementations • 23 Feb 2023 • Vittoria Dentella, Elliot Murphy, Gary Marcus, Evelina Leivada

With successes in bottom-up challenges partially overshadowing shortcomings, the 'human-like' performance of Large Language Models has raised the question of how linguistic performance is achieved by algorithms.