Search Results for author: Junhong Shen

Found 8 papers, 7 papers with code

UPS: Efficiently Building Foundation Models for PDE Solving via Cross-Modal Adaptation

1 code implementation11 Mar 2024 Junhong Shen, Tanya Marwah, Ameet Talwalkar

We present Unified PDE Solvers (UPS), a data- and compute-efficient approach to developing unified neural operators for diverse families of spatiotemporal PDEs from various domains, dimensions, and resolutions.

Multi-Task Learning

Tag-LLM: Repurposing General-Purpose LLMs for Specialized Domains

1 code implementation6 Feb 2024 Junhong Shen, Neil Tenenholtz, James Brian Hall, David Alvarez-Melis, Nicolo Fusi

Large Language Models (LLMs) have demonstrated remarkable proficiency in understanding and generating natural language.

TAG Zero-shot Generalization

Cross-Modal Fine-Tuning: Align then Refine

1 code implementation11 Feb 2023 Junhong Shen, Liam Li, Lucio M. Dery, Corey Staten, Mikhail Khodak, Graham Neubig, Ameet Talwalkar

Fine-tuning large-scale pretrained models has led to tremendous progress in well-studied modalities such as vision and NLP.

AutoML

Efficient Architecture Search for Diverse Tasks

1 code implementation15 Apr 2022 Junhong Shen, Mikhail Khodak, Ameet Talwalkar

While neural architecture search (NAS) has enabled automated machine learning (AutoML) for well-researched areas, its application to tasks beyond computer vision is still under-explored.

Neural Architecture Search Protein Folding

Theoretically Principled Deep RL Acceleration via Nearest Neighbor Function Approximation

no code implementations9 Oct 2021 Junhong Shen, Lin F. Yang

To mitigate these issues, we propose a theoretically principled nearest neighbor (NN) function approximator that can improve the value networks in deep RL methods.

Reinforcement Learning (RL)

Iterative Teacher-Aware Learning

1 code implementation NeurIPS 2021 Luyao Yuan, Dongruo Zhou, Junhong Shen, Jingdong Gao, Jeffrey L. Chen, Quanquan Gu, Ying Nian Wu, Song-Chun Zhu

Recently, the benefits of integrating this cooperative pedagogy into machine concept learning in discrete spaces have been proved by multiple works.

Cannot find the paper you are looking for? You can Submit a new open access paper.