One-Way ANOVA Calculator
One-way ANOVA: compare means across 2 or more groups. Outputs F-statistic, degrees of freedom, p-value, eta-squared effect size + per-group descriptive statistics.
One-Way ANOVA Calculator
How to use the ANOVA Calculator
Enter your groups
One group per line; values separated by commas or spaces. Minimum 2 groups (with 2+ values each), but ANOVA is most useful for 3+ groups (use t-test for exactly 2). Groups can have different sample sizes; the math accounts for this.
Read the F-statistic + p-value
F is the ratio of "between-group variability" to "within-group variability." Large F → likely real differences between groups. p-value tells you the probability of seeing this F (or larger) if all group means were truly equal. p < 0.05 typically means at least one group differs.
Check η² for effect size
Eta-squared (η²) is the proportion of total variance explained by group membership. 0.01 small, 0.06 medium, 0.14 large. Important: with large samples F can be highly significant but η² small — a real-but-tiny effect. Always report both p and η².
Run post-hoc tests if significant
ANOVA significance tells you "at least one group differs" but NOT which one(s). To find the differing pair(s), run post-hoc tests: Tukey HSD (most common, all pairwise comparisons); Bonferroni (conservative); Dunnett (each group vs control). Most stats software automates these.
ANOVA — comparing means across 3 or more groups without inflating false positives
Analysis of Variance (ANOVA), developed by Ronald Fisher in the 1920s, solves a specific problem: when you have 3 or more groups to compare, running pairwise t-tests inflates the false-positive rate. Comparing 4 groups via 6 separate t-tests at α = 0.05 each gives an actual false-positive rate of ~26%, not 5%. ANOVA provides a SINGLE omnibus test that maintains the overall α level. If ANOVA is significant, you then run post-hoc tests (Tukey HSD, Bonferroni) with proper multiple-comparison correction to find which specific groups differ. The math decomposes total variance into "between-group" and "within-group" components; the F-statistic is the ratio of these. Large F → group differences are larger than within-group noise → likely real differences.
Why ANOVA + not just multiple t-tests
With k groups, there are k(k-1)/2 possible pairwise comparisons. For k=4 groups: 6 comparisons. At α = 0.05 per comparison, the family-wise error rate (probability of at least one false positive) is 1 − (1-0.05)^6 ≈ 26%. With k=10 groups (45 comparisons): family-wise error ≈ 90%. ANOVA controls this by running ONE test that asks "is there any difference among ALL groups?" — if no, stop. If yes, follow up with controlled post-hoc tests. This is why scientific research + clinical trials always start with ANOVA before pairwise comparisons when comparing 3+ conditions.
Comparing 4 groups via 6 separate t-tests inflates the false-positive rate from 5% to 26%. ANOVA's single omnibus test controls this. Run ANOVA first, then post-hoc tests.
What the F-statistic actually measures
F = MS_between / MS_within. MS_between ("mean square between groups") measures how much group means differ from the overall mean — high when groups differ substantially. MS_within ("mean square within groups") measures how much individual values differ from their own group mean — measures noise inherent to the data. F ratio interpretation: F=1 means between-group variability ≈ within-group noise (no signal). F=2 means signal is twice the noise. F=10+ means strong signal. The p-value translates F into "probability of seeing this F if all groups were truly identical."
The ASEAN multivariate testing context
Multi-armed product experiments (A/B/C/D testing) are common across ASEAN platforms — Grab, Shopee, Sea, Lazada, GoTo all run 3+ variant tests regularly. For continuous metrics (revenue per user, session length, time-to-purchase): one-way ANOVA is the right omnibus test. For categorical metrics (conversion rate): chi-square test of independence is the analog. Common ASEAN cross-country comparison: testing whether some metric (engagement, ARPU, retention) differs across SG/MY/PH/ID/TH/VN markets. ANOVA tells you "is there any country-level difference?" Tukey HSD post-hoc tells you specifically which countries differ. Watch out: with large samples typical of ASEAN platforms (often 100K+ per group), every test becomes statistically significant. Always check η² to confirm differences are practically meaningful, not just statistically detectable.
10 Things to Know About ANOVA
Ronald Fisher 1920s developed ANOVA for agricultural research at Rothamsted Experimental Station — testing fertiliser effects across plots.
F = MS_between / MS_within. Ratio of "signal" (group differences) to "noise" (within-group variability).
ANOVA replaces multiple t-tests when comparing 3+ groups — prevents 26%+ false-positive rate from naive pairwise testing.
η² (eta-squared): effect size. 0.01 small, 0.06 medium, 0.14 large. Proportion of variance explained.
Significant ANOVA → run post-hoc tests (Tukey HSD, Bonferroni, Dunnett) to find which groups differ.
Assumes normality + equal variances. For unequal variances: Welch\'s ANOVA. For non-normal: Kruskal-Wallis.
F-distribution is right-skewed, always positive. Large F always indicates more between-group variation than within-group.
For 2 groups: ANOVA is mathematically equivalent to a t-test. F = t². Use t-test directly for clarity.
"One-way" = one categorical predictor. "Two-way" = two predictors with interaction. "Three-way" + factorial designs handle complex experiments.
ASEAN A/B/C/D testing: ANOVA + Tukey HSD reveals which specific variants drive significant differences, not just "any difference exists."
Frequently Asked Questions
-
Family-wise error rate balloons. With k groups, k(k-1)/2 pairwise tests; at α=0.05 each, the probability of AT LEAST ONE false positive = 1 − (0.95)^n_comparisons. 4 groups (6 comparisons) → 26% false positive rate. 10 groups (45 comparisons) → 90%. ANOVA gives ONE test maintaining overall α = 0.05. Then post-hoc tests apply proper multiple-comparison correction (Tukey HSD, Bonferroni) on the surviving question.
-
One-way ANOVA (this tool): one categorical predictor (e.g., "Diet Type" with 4 levels). Two-way ANOVA: two predictors + interaction (e.g., "Diet Type" × "Exercise Level"). Two-way tests both main effects AND whether the effect of one predictor depends on the level of the other (interaction effect). For interaction-effect testing, use specialised software (R aov(), Python statsmodels, SPSS).
-
Standard ANOVA assumes equal variances (homoscedasticity). Welch\'s ANOVA doesn\'t — uses adjusted degrees of freedom to handle unequal variances. Robust to violations. Detection: Levene\'s test or Bartlett\'s test on group variances. Practical rule: if the largest standard deviation is more than 2× the smallest, use Welch\'s ANOVA instead. R aov() does standard; oneway.test() with var.equal=FALSE does Welch\'s. This tool currently does standard ANOVA; for unequal variances, validate with R or Python.
-
Tukey HSD: most common; balanced + powerful; all pairwise comparisons; controls family-wise error. Bonferroni: very conservative; α/n_comparisons; easy to apply manually. Scheffé: flexible for arbitrary contrasts beyond pairs. Dunnett: best when comparing each treatment to a control (don\'t need all pairs). Default choice: Tukey HSD unless you have a specific reason for another. This calculator doesn\'t run post-hoc tests directly — use R (TukeyHSD function), Python (statsmodels), or SPSS for them.
-
Kruskal-Wallis = non-parametric alternative to ANOVA. Use when: data is severely skewed, has heavy outliers, or is on an ordinal scale (rankings, Likert scales). Tests whether group medians differ rather than means. Less powerful than ANOVA when ANOVA\'s assumptions hold, but more robust when they\'re violated. Available in R (kruskal.test), Python (scipy.stats.kruskal), SPSS, JASP.
-
Standard APA format: "F(df_between, df_within) = X.XX, p = .XXX, η² = X.XX". Example: "Diet had a significant effect on weight loss, F(3, 56) = 5.42, p = .002, η² = .23." Always include: (1) F-statistic + both degrees of freedom; (2) exact p-value (or "< .001"); (3) effect size (η², ω², or partial η²); (4) descriptive stats (means + SDs) for each group; (5) post-hoc comparison results if applicable.
-
For exactly 2 groups, F should equal t² exactly. If they differ, it usually means: (1) the ANOVA assumes pooled variance (equal-variance assumption) while Welch\'s t-test doesn\'t; (2) rounding errors; (3) one of the calculations had an input difference. For 2-group comparisons, use the t-test directly — it\'s mathematically equivalent and reporting "F" instead of "t" is unconventional.
-
Cohen\'s conventions for η²: 0.01 small, 0.06 medium, 0.14 large. Interpretation: η² = 0.14 means group membership explains 14% of total variance. Larger η² = stronger effect. In business contexts: η² ≥ 0.05 often "important enough to act on"; below that, statistical significance might exceed practical importance.
-
No. All calculations run in your browser via JavaScript. Open DevTools → Network and confirm zero outbound requests. Data stays on your device. Safe for confidential research + business data.
-
Pair with: T-Test (RT-CNV-090) for 2-group comparisons; Chi-Square (RT-CNV-091) for categorical data; Sample Size Calculator (RT-CNV-093) for pre-test power analysis; Linear Regression (RT-CNV-084) for continuous predictors. External: R (aov, TukeyHSD), Python (scipy.stats.f_oneway, statsmodels), SPSS, JASP, JMP — all support full ANOVA + post-hoc workflows.
Related News
You may be interested in these recent stories from our newsroom.
No related news yet for this tool. Our editorial team publishes new pieces every week.
Browse all news →75 more free tools
Calculators, converters, security tools — no signup.