← Google · Gemini Individual model view Google · Gemini

gemini-3-flash-preview

Appears in 6 benchmarksMean lean (confidence − pass rate): +0.104/6 benchmarks lean overconfident (prospective probe)

Positioning spread: every benchmark, one model

0.000.250.500.751.00SQuAD (factual recall)MMLU-Pro (knowledge)LegalBench (legal reasoning)MathBench (competition math)OmniMath (advanced math)SciCode (scientific code)performanceconfidence (red gap = overconfident)
Performance vs. confidence for gemini-3-flash-preview, per benchmark (prospective probe).
BenchmarkTask accConfidenceF₁Leans
SQuAD (factual recall)0.590.740.78+0.15 overconfident
MMLU-Pro (knowledge)0.610.920.78+0.31 overconfident
LegalBench (legal reasoning)0.880.820.86-0.06 cautious
MathBench (competition math)0.981.000.99+0.02 calibrated
OmniMath (advanced math)0.710.990.83+0.28 overconfident
SciCode (scientific code)0.590.520.64-0.07 cautious

In the full cloud

-3-3-2-2-1-100112233Performance z-score within benchmark/probe →Confidence z-score →
gemini-3-flash-preview conditions all other model/condition points equal relative confidence and pass rate

Pairwise signal: pairs involving gemini-3-flash-preview

Match accuracy controls for the performance base-rate gap
gemini-3-flash-preview pairs
18/ 171
gemini-3-flash-preview mean tau
+0.080
All-pairs mean
+0.037
gemini-3-flash-preview p<0.05
12(66.7%)
-1.0-0.50.00.51.0Pair signal: do confidence gaps rank performance gaps? (Kendall tau-b)
all model pairs (observed) base-rate-matched null calibration-preserving null gemini-3-flash-preview pair (filled = p<0.05) gemini-3-flash-preview mean all-pairs mean

The four metacognitive outcomes

No curated cases for this selection yet — outcome-matrix extraction currently covers a sample of MMLU-Pro trials.
vs gemini-2.0-flash-001 →vs gemini-2.5-flash →vs gemini-2.5-pro →vs gemini-3-pro-preview →vs gemini-3.1-pro-preview → Compare with anything →