no code implementations • bioRxiv 2022 • Zeming Lin, Halil Akin, Roshan Rao, Brian Hie, Zhongkai Zhu, Wenting Lu, Allan dos Santos Costa, Maryam Fazel-Zarandi, Tom Sercu, Sal Candido, Alexander Rives
We find that as models are scaled they learn information enabling the prediction of the three-dimensional structure of a protein at the resolution of individual atoms.
1 code implementation • NeurIPS 2021 • Joshua Meier, Roshan Rao, Robert Verkuil, Jason Liu, Tom Sercu, Alex Rives
Modeling the effect of sequence variation on function is a fundamental problem for understanding and designing proteins.
1 code implementation • 13 Feb 2021 • Roshan Rao, Jason Liu, Robert Verkuil, Joshua Meier, John F. Canny, Pieter Abbeel, Tom Sercu, Alexander Rives
Unsupervised protein language models trained across millions of diverse sequences learn structure and function of proteins.
no code implementations • ICLR 2021 • Roshan Rao, Joshua Meier, Tom Sercu, Sergey Ovchinnikov, Alexander Rives
Unsupervised contact prediction is central to uncovering physical, structural, and functional constraints for protein structure determination and design.
no code implementations • ICLR Workshop EBM 2021 • Nick Bhattacharya, Neil Thomas, Roshan Rao, Justas Daupras, Peter K Koo, David Baker, Yun S. Song, Sergey Ovchinnikov
On the one hand, factored attention is a direct simplification of multihead scaled dot-product attention in the Transformer.
2 code implementations • 26 Oct 2019 • Daniel Seita, David Chan, Roshan Rao, Chen Tang, Mandi Zhao, John Canny
Learning from demonstrations is a popular tool for accelerating and reducing the exploration requirements of reinforcement learning.
5 code implementations • NeurIPS 2019 • Roshan Rao, Nicholas Bhattacharya, Neil Thomas, Yan Duan, Xi Chen, John Canny, Pieter Abbeel, Yun S. Song
Semi-supervised learning has emerged as an important paradigm in protein modeling due to the high cost of acquiring supervised protein labels, but the current literature is fragmented when it comes to datasets and standardized evaluation techniques.
1 code implementation • 31 Jul 2018 • David M. Chan, Roshan Rao, Forrest Huang, John F. Canny
Modern datasets and models are notoriously difficult to explore and analyze due to their inherent high dimensionality and massive numbers of samples.