Search Results for author: H S V N S Kowndinya Renduchintala

Found 2 papers, 1 papers with code

SMART: Submodular Data Mixture Strategy for Instruction Tuning

1 code implementation13 Mar 2024 H S V N S Kowndinya Renduchintala, Sumit Bhatia, Ganesh Ramakrishnan

Instruction Tuning involves finetuning a language model on a collection of instruction-formatted datasets in order to enhance the generalizability of the model to unseen tasks.

Language Modelling

INGENIOUS: Using Informative Data Subsets for Efficient Pre-Training of Language Models

no code implementations11 May 2023 H S V N S Kowndinya Renduchintala, KrishnaTeja Killamsetty, Sumit Bhatia, Milan Aggarwal, Ganesh Ramakrishnan, Rishabh Iyer, Balaji Krishnamurthy

A salient characteristic of pre-trained language models (PTLMs) is a remarkable improvement in their generalization capability and emergence of new capabilities with increasing model capacity and pre-training dataset size.

Cannot find the paper you are looking for? You can Submit a new open access paper.