TestSuiteBench eth-sri/tsb-mutants Updated 8 days ago • 1.26k eth-sri/tsb-reference_tests Updated 8 days ago • 553 eth-sri/tsb-reference_impl Updated 8 days ago • 710
Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15, 2025 • 272 • 118 eth-sri/smiles-eval Viewer • Updated Aug 15, 2025 • 167 • 63 zai-org/humaneval-x Updated Oct 25, 2022 • 4.84k • 97 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15, 2025 • 473 • 24 • 1
Generative Compilation Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 6 eth-sri/API-Upgrade Viewer • Updated Jul 16 • 34 • 44 eth-sri/CRUST-bench Viewer • Updated Jul 16 • 117 • 51
Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 6
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 2.2k • 76 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 299 • 95 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 433 • 2.01k eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 2.52k • 53 • 2
TestSuiteBench eth-sri/tsb-mutants Updated 8 days ago • 1.26k eth-sri/tsb-reference_tests Updated 8 days ago • 553 eth-sri/tsb-reference_impl Updated 8 days ago • 710
Generative Compilation Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 6 eth-sri/API-Upgrade Viewer • Updated Jul 16 • 34 • 44 eth-sri/CRUST-bench Viewer • Updated Jul 16 • 117 • 51
Generative Compilation: On-the-Fly Compiler Feedback as AI Generates Code Paper • 2607.13921 • Published Jul 15 • 6
Constrained Diffusion Tasks Datasets used in the paper "Constrained Decoding of Diffusion LLMs for Context-Free Grammars". eth-sri/json-mode-eval-extended Viewer • Updated Nov 15, 2025 • 272 • 118 eth-sri/smiles-eval Viewer • Updated Aug 15, 2025 • 167 • 63 zai-org/humaneval-x Updated Oct 25, 2022 • 4.84k • 97 eth-sri/HumanEval-MRI-Cpp Viewer • Updated Aug 15, 2025 • 473 • 24 • 1
SWT-Bench Variations of the SWT-Bench pre-formatted dataset used for the paper "SWT-Bench: Testing and Validating Real-World Bug-Fixes with Code Agents" eth-sri/SWT-bench_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 2.2k • 76 eth-sri/SWT-bench_Lite_bm25_27k_zsb Viewer • Updated Feb 25, 2025 • 299 • 95 eth-sri/SWT-bench_Verified_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 433 • 2.01k eth-sri/SWT-bench_bm25_27k_zsp Viewer • Updated Feb 25, 2025 • 2.52k • 53 • 2
