1 code implementation • 31 Oct 2022 • Hanwei Xu, Yujun Chen, Yulun Du, Nan Shao, Yanggang Wang, Haiyu Li, Zhilin Yang
Prompt-based techniques have demostrated great potential for improving the few-shot generalization of pretrained language models.
no code implementations • 18 Jan 2022 • Hanwei Xu, Yujun Chen, Yulun Du, Nan Shao, Yanggang Wang, Haiyu Li, Zhilin Yang
We propose a multitask pretraining approach ZeroPrompt for zero-shot generalization, focusing on task scaling and zero-shot prompting.