Real-time Animation Generation and Control on Rigged Models via Large Language Models

1 code implementation • 27 Oct 2023 • Han Huang, Fernanda De La Torre, Cathy Mengying Fang, Andrzej Banburski-Fahey, Judith Amores, Jaron Lanier

We introduce a novel method for real-time animation control and generation on rigged models using natural language input.

Language Modelling Large Language Model +1

LLMR: Real-time Prompting of Interactive Worlds using Large Language Models

no code implementations • 21 Sep 2023 • Fernanda De La Torre, Cathy Mengying Fang, Han Huang, Andrzej Banburski-Fahey, Judith Amores Fernandez, Jaron Lanier

We present Large Language Model for Mixed Reality (LLMR), a framework for the real-time creation and modification of interactive Mixed Reality experiences using LLMs.

Language Modelling Large Language Model +4

Steps towards prompt-based creation of virtual worlds

no code implementations • 10 Nov 2022 • Jasmine Roberts, Andrzej Banburski-Fahey, Jaron Lanier

Large language models trained for code generation can be applied to speaking virtual worlds into existence (creating virtual worlds).

Code Generation

The Autodidactic Universe

no code implementations • 29 Mar 2021 • Stephon Alexander, William J. Cunningham, Jaron Lanier, Lee Smolin, Stefan Stanojevic, Michael W. Toomey, Dave Wecker

We discover maps that put each of these matrix models in correspondence with both a gauge/gravity theory and a mathematical model of a learning machine, such as a deep recurrent, cyclic neural network.