Independent Samples t-Test
Hypothesis TestingCompares the means of two independent groups to determine whether there is a statistically significant difference between them.
When to Use
Use this test when you have a continuous outcome measured in two separate groups and you want to know whether the group means differ. For example, comparing blood pressure between a treatment group and a control group, or comparing test scores between two classrooms.
Assumptions
- The dependent variable is continuous (interval or ratio scale).
- Observations in each group are independent of one another.
- The dependent variable is approximately normally distributed within each group, or sample sizes are large enough for the Central Limit Theorem to apply (roughly N >= 30 per group).
- If you choose the pooled method, group variances should be reasonably similar. easyCris also reports a Folded F variance check as supplemental context.
Required Inputs
| Input | Type | Notes |
|---|---|---|
| Group 1 | Numeric | Continuous values for the first group |
| Group 2 | Numeric | Continuous values for the second group |
| Parameter | Default | Options |
|---|---|---|
| Assume Equal Variance | False | True = treat the Pooled row as the selected method. False = treat the Satterthwaite row as the selected method. |
| Significance Level | 0.05 | Alpha level used for p-values and confidence intervals. |
Output Metrics
| Metric | What it means |
|---|---|
| N | Number of observations in each group. |
| Mean | Arithmetic mean of each group. |
| Std Dev | Standard deviation of each group. |
| Std Error | Standard error of the mean for each group. |
| Minimum | Minimum value in each group. |
| Maximum | Maximum value in each group. |
| DF | Degrees of freedom shown for each method row in the T-Tests table. |
| t Value | Test statistic shown for both the Pooled and Satterthwaite rows. |
| Pr > |t| | Two-tailed p-value shown for each method row in the T-Tests table. |
| Num DF | Numerator degrees of freedom in the Equality of Variances table. |
| Den DF | Denominator degrees of freedom in the Equality of Variances table. |
| F Value | Folded F statistic shown in the Equality of Variances table. |
| Pr > F | P-value for the Folded F variance comparison. Use it as supporting context rather than as an automatic method selector inside easyCris. |
| Mean Diff | Difference between the two group means (Group 1 - Group 2), shown in the confidence-limits table. |
| 95% CL Lower | Lower confidence limit for the mean difference shown for each method row in the confidence-limits table. |
| 95% CL Upper | Upper confidence limit for the mean difference shown for each method row in the confidence-limits table. |
Interpretation
- If the p-value (Pr > |t|) is less than your chosen alpha (typically 0.05), the difference between group means is statistically significant.
- easyCris reports both the Pooled and Satterthwaite rows. Interpret the row that matches the method you selected in the app.
- The Folded F table provides context about variance similarity between the two groups, but easyCris does not silently switch your chosen method for you.
- The mean difference tells you the direction and magnitude of the effect. Always report the confidence interval alongside the p-value.
- A confidence interval that does not include zero is consistent with a significant result.
- Statistical significance does not imply practical importance. Consider whether the observed mean difference is meaningful in your research context.
Common Pitfalls
- Choosing the pooled method when group variances are clearly unequal can inflate the Type I error rate; in that situation, the Satterthwaite method is usually safer.
- Do not assume the app automatically overrides your chosen method based on the variance check. The guide and the result table should be read together.
- The t-test is sensitive to outliers, which can distort group means and inflate or mask real differences.
- Small sample sizes reduce statistical power. A non-significant result with a small sample does not mean there is no difference, only that you could not detect one.
- Running multiple t-tests across many group pairs without correction inflates the family-wise error rate. Use ANOVA with post-hoc tests instead.
How It Works
- Calculate the mean and variance for each group.
- Compute both t-statistic rows shown in the app: the pooled version uses a common variance estimate, while the Satterthwaite version uses separate group variances.
- Determine the degrees of freedom. For pooled: N1 + N2 - 2. For Satterthwaite: the unequal-variance approximation based on each group's variance and sample size.
- Compute the Folded F variance comparison from the two sample variances and report it in the Equality of Variances table.
- Compare the t-statistic to the t-distribution with the appropriate degrees of freedom to obtain the p-value.
Citations
References
- Student (1908). The probable error of a mean. Biometrika, 6(1), 1-25.
- Welch, B. L. (1947). The generalization of "Student's" problem when several different population variances are involved. Biometrika, 34(1-2), 28-35.