Think Outside the Code: Brainstorming Boosts Large Language Models in Code Generation

no code implementations • 18 May 2023 • Xin-Ye Li, Jiang-Tian Xue, Zheng Xie, Ming Li

We demonstrate that Brainstorm significantly enhances the ability of LLMs to solve competition-level programming problems, resulting in a more than 50% increase in the pass@$k$ metrics for ChatGPT on the CodeContests benchmark, achieving state-of-the-art performance.

Code Generation