Search Results for author:
Found 3 papers, 2 papers with code
Your Transformer is Secretly Linear
This regularization improves performance metrics on benchmarks like Tiny Stories and SuperGLUE and as well successfully decreases the linearity of the models.
OmniFusion Technical Report
We propose an \textit{OmniFusion} model based on a pretrained LLM and adapters for visual modality.
Ranked #40 on
Visual Question Answering
on MM-Vet
The Shape of Learning: Anisotropy and Intrinsic Dimensions in Transformer-Based Models
In this study, we present an investigation into the anisotropy dynamics and intrinsic dimension of embeddings in transformer architectures, focusing on the dichotomy between encoders and decoders.
