InfraBench

hard · software-engineering

AG Grid/Charts composition for n1x

Add composable AG Grid and AG Charts client instrumentation to n1x.

Task version0.1.0

Checksum94e0778e2fa4

Published attempts6

Full reward1.00

Current task results

Evaluation comparison

Each bar averages that model configuration's verifier rewards for this task. The latest published batch 2026-08-05__10-04-35 contains 6 attempts across 3 model configurations.

gpt-5.6-solopenai
82.0%± 0.0 pp SD
2/2 scored attempts
v9m-rl-learnability-tp8openai
80.0%± 2.8 pp SD
2/2 scored attempts
gpt-5.6-lunaopenai
58.0%± 11.3 pp SD
2/2 scored attempts

± is sample standard deviation across scored attempts. The line spans minimum to maximum; the heavier marker is the mean. Fixed 0–100 scale.

Latest published cohort

Verifier criteria

Pass rate across 6 attempts from 3 model configurations in batch 2026-08-05__10-04-35. Reward weight is how much each check contributes to one attempt's total score. Expand a criterion to see attempt outcomes by model configuration.

core engine and unrelated capabilities are unchanged4%0/60%

core engine and unrelated capabilities are unchanged attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 failed0/2
gpt-5.6-solopenai	Attempt 1 failed Attempt 2 failed0/2
v9m-rl-learnability-tp8openai	Attempt 1 failed Attempt 2 failed0/2

web-ag resolves web and renders its managed helper4%6/6100%

web-ag resolves web and renders its managed helper attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

web-ag pins ag-charts-community1%6/6100%

web-ag pins ag-charts-community attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

web-ag pins ag-charts-enterprise1%6/6100%

web-ag pins ag-charts-enterprise attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

web-ag pins ag-charts-react1%6/6100%

web-ag pins ag-charts-react attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

web-ag pins ag-grid-community1%6/6100%

web-ag pins ag-grid-community attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

web-ag pins ag-grid-enterprise1%6/6100%

web-ag pins ag-grid-enterprise attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

web-ag pins ag-grid-react1%6/6100%

web-ag pins ag-grid-react attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

client entrypoint configures both AG license managers8%5/683%

client entrypoint configures both AG license managers attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 passed1/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

AG modules register exactly once across a client reload8%5/683%

AG modules register exactly once across a client reload attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 passed1/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

standalone AG exposes the browser license env3%5/683%

standalone AG exposes the browser license env attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 failed1/2

standalone AG documents the managed client setup2%6/6100%

standalone AG documents the managed client setup attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

web-ag contributes through a web-owned client seam2%6/6100%

web-ag contributes through a web-owned client seam attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

web-posthog contributes through the shared client seam4%6/6100%

web-posthog contributes through the shared client seam attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

standalone PostHog behavior is preserved4%4/667%

standalone PostHog behavior is preserved attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 failed0/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

standalone PostHog contains no AG output2%6/6100%

standalone PostHog contains no AG output attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

AG and PostHog execute together in plugin order 16%4/667%

AG and PostHog execute together in plugin order 1 attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 failed0/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

AG and PostHog execute together in plugin order 26%4/667%

AG and PostHog execute together in plugin order 2 attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 failed0/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

web-ag and infra establish one shared input map4%0/60%

web-ag and infra establish one shared input map attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 failed0/2
gpt-5.6-solopenai	Attempt 1 failed Attempt 2 failed0/2
v9m-rl-learnability-tp8openai	Attempt 1 failed Attempt 2 failed0/2

combined env map is stable in plugin order 12%0/60%

combined env map is stable in plugin order 1 attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 failed0/2
gpt-5.6-solopenai	Attempt 1 failed Attempt 2 failed0/2
v9m-rl-learnability-tp8openai	Attempt 1 failed Attempt 2 failed0/2

combined env map is stable in plugin order 22%0/60%

combined env map is stable in plugin order 2 attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 failed0/2
gpt-5.6-solopenai	Attempt 1 failed Attempt 2 failed0/2
v9m-rl-learnability-tp8openai	Attempt 1 failed Attempt 2 failed0/2

web-ag and infra classify the license for Vercel2%5/683%

web-ag and infra classify the license for Vercel attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 failed1/2

Vercel env behavior is stable in plugin order 13%5/683%

Vercel env behavior is stable in plugin order 1 attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 failed1/2

Vercel env behavior is stable in plugin order 23%5/683%

Vercel env behavior is stable in plugin order 2 attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 failed1/2

web-ag and infra expose the license through local env3%3/650%

web-ag and infra expose the license through local env attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 failed Attempt 2 failed0/2
v9m-rl-learnability-tp8openai	Attempt 1 failed Attempt 2 passed1/2

local env preserves AG and Google in plugin order 12%3/650%

local env preserves AG and Google in plugin order 1 attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 failed Attempt 2 failed0/2
v9m-rl-learnability-tp8openai	Attempt 1 failed Attempt 2 passed1/2

local env preserves AG and Google in plugin order 22%3/650%

local env preserves AG and Google in plugin order 2 attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 failed Attempt 2 failed0/2
v9m-rl-learnability-tp8openai	Attempt 1 failed Attempt 2 passed1/2

plain web and infra contain no AG-specific output6%6/6100%

plain web and infra contain no AG-specific output attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

repeated apply is byte-for-byte idempotent2%6/6100%

repeated apply is byte-for-byte idempotent attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

apply preserves project-owned package keys3%6/6100%

apply preserves project-owned package keys attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

removing web-ag preserves PostHog and shared instrumentation6%4/667%

removing web-ag preserves PostHog and shared instrumentation attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 failed Attempt 2 failed0/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

repository smoke and downstream lint coverage include web-ag3%6/6100%

repository smoke and downstream lint coverage include web-ag attempt outcomes by model configuration
Model configuration	Attempts
gpt-5.6-lunaopenai	Attempt 1 passed Attempt 2 passed2/2
gpt-5.6-solopenai	Attempt 1 passed Attempt 2 passed2/2
v9m-rl-learnability-tp8openai	Attempt 1 passed Attempt 2 passed2/2

Published evidence

Individual attempts

01v9m-rl-learnability-tp8partial0.8256m2026-08-05__10-04-35 02v9m-rl-learnability-tp8partial0.781h 2m2026-08-05__10-04-35 03gpt-5.6-solpartial0.8214m2026-08-05__10-04-35 04gpt-5.6-solpartial0.8213m2026-08-05__10-04-35 05gpt-5.6-lunapartial0.507m2026-08-05__10-04-35 06gpt-5.6-lunapartial0.665m2026-08-05__10-04-35