Data tables for swebench-lite

Home Paper Code

Reports

• ex.html
• ex_v_model.html
• ex_v_model_acc.html
• model.html

Report sections

• fig_accs_and_pvalues.html
• fig_cov_baseline.html
• fig_diff_vs_sum.html
• fig_marginals.html
• fig_pass_at_k.html
• model_table.html

Tables

• example.parquet
• input.parquet
• model.jsonl
• summary.parquet
• summary_stats.jsonl