ODEX is an open-domain 📖, multilingual 🌍, execution-based 🛠 natural language to code generation 💻 data benchmark. ODEX has 945 NL-Code pairs spanning 79 diverse libraries, along with 1,707 human-written test cases for execution. The NL-Code pairs are harvested from StackOverflow forums to encourage natural and practical coding queries. Moreover, ODEX supports four natural languages as intents: English, español (Spanish), 日本語 (Japanese), and Pусский (Russian).
Paper | Code | Results | Date | Stars |
---|