Every stored patch file was scored.
This is the full end-to-end run on every prs/*.json file in this repo:
2,098 files, not the labeled 50-case fixtures and not a sample.
The 15,575-row Airflow index has no diffs, so it was not executed.
full-stored-patch-latest.json.
1) Full stored-patch run VERIFIED
Every stored patch file under corpus/**/prs/ was executed with local aiv-cli 2.0.
That includes Airflow e2e-proof (726), Airflow year folder (493), and six other projects (879).
Total files 2,098 / unique PRs 2,080. Primary blocks: assertion-free tests 50, AI-generated markers 38,
placeholder text 15, syntax 7, plus 3 other invariant rules.
Every project table
Every blocked PR
Walkthrough
· Raw: full-stored-patch-latest.json
2) Labeled 50-case fixtures VERIFIED · separate suite
Designed ground-truth fixtures only. Not the 2,098-file full run.
Loading fixture datasets…
3) Abandoned Airflow PRs → labels → AIV
Same diffs, labeled and pushed through AIV.
Among ai_disclosed: hard-caught
—
(disclosure alone is not a block reason).
ai_disclosed — markers empty, local AIV hard=false.
Open Actions on that PR to see the live gate run.
Per-PR ledger
| Origin | Label | Hard | Block | Advisory | Disclosed | Bench | Title |
|---|
Scoring note: hard column prefers aiv_head_full (head materialize + full config).
Raw: abandoned-labeled-latest.json
4) Confirmed ChatGPT gold set VERIFIED
Tiny confirmed-disclosure cohort.
4) Last 6 months and full year
GitHub search totals for 22 Apr 2026–22 Oct 2026 and 22 Oct 2025–22 Oct 2026,
next to the labeled sample stored in this repo. Search totals are not a census,
and Generated-by on Flink and curl includes template text.
| Project | PRs, 6 months | PRs, 1 year | Generated-by, 6 months | Generated-by, 1 year | Sample, 6 months | Sample, 1 year |
|---|---|---|---|---|---|---|
| Airflow | 8,552 | 15,575 | 5,174 | 7,474 | 305 | 555 |
| Flink | 1,584 | 2,441 | 986 | 1,012 | 32 | 51 |
| Kafka | 1,813 | 3,181 | 43 | 55 | 32 | 38 |
| curl | 1,894 | 3,853 | 322 | 657 | 13 | 18 |
| Godot | 3,668 | 7,589 | 47 | 79 | 39 | 62 |
| Ghostty | 1,192 | 2,492 | 10 | 27 | 32 | 53 |
| COSMIC compositor | 242 | 425 | 6 | 7 | 20 | 41 |
The Airflow year is now a full index of 15,575 pull requests
(4,329 disclosed, 7,265 merged, 2,182 closed unmerged, 1,526 tool mentions, 25 slop-language, 248 open).
Counts: airflow-all-latest.json.
Rows: corpus/airflow-all/prs.jsonl.
Airflow issues stored: 1,100 in 6 months, 2,427 in the year.
Dev-list messages: 1,965 and 4,377.
Raw: windows-latest.json
NOT CLAIMED policy
Validate independently
Everything on this page is backed by JSON in /docs/data.
Live CI is the open PRs on this repository. Gate source and scripts live in
aiv-integrity-gate.
# From aiv-integrity-gate python benchmarks/airflow/scripts/generate-labeled-corpus.py python benchmarks/airflow/scripts/run-labeled-benchmark.py python benchmarks/airflow/scripts/benchmark-abandoned-labeled.py --limit 60 --inject --inject-clean 8 python benchmarks/airflow/scripts/rescore-ai-signal-head.py # Compare outputs to docs/data/*.json on this Pages site