Hypothesis Un-Equal Variance

Hypothesis testing of data may include two populations that have un-equal standard deviations. The t-test for differences considered in a previous post used the assumption of equal variances to pool the variance value. In this test, we want to consider if one population is different in some way than the other and we use the samples from each population directly even if the population have difference variances.

Test Setup

The null hypothesis for a paired t-test is H_o: μ₁ = μ₂.

The three alternate hypothesis become:

μ₁ ≥ μ₂

μ₁ ≤ μ₂

μ₁ ≠ μ₂

We are considering the two population standard deviations are not the same. You can use the F-test hypothesis test to check this assumption and if they are similar enough you might be better served with the paired comparison assuming equal variances.

We calculate the test statistic using

$$ \large\displaystyle t=\frac{{{{\bar{X}}}_{1}}-{{{\bar{X}}}_{2}}}{\sqrt{\frac{s_{1}^{2}}{{{n}_{1}}}+\frac{s_{1}^{2}}{{{n}_{2}}}}}$$

where, degrees of freedom is a bit more complex (the Welch-Satterthwaite formula) and is

$$ \large\displaystyle DF=\frac{1}{\frac{{{\left( \frac{\frac{s_{1}^{2}}{{{n}_{1}}}}{\frac{s_{1}^{2}}{{{n}_{1}}}+\frac{s_{2}^{2}}{{{n}_{2}}}} \right)}^{2}}}{{{n}_{1}}-1}+\frac{{{\left( \frac{\frac{s_{2}^{2}}{{{n}_{2}}}}{\frac{s_{1}^{2}}{{{n}_{1}}}+\frac{s_{2}^{2}}{{{n}_{2}}}} \right)}^{2}}}{{{n}_{2}}-1}}$$

The critical value (or rejection region) for the three tests given a (1-α)100% confidence level becomes:

Reject H_o if t > t_α,df

Reject H_o if t < t_α,df

Reject H_o if |t| > t_α/2,df

Example

Let’s say we have two processes creating the top tubes of bicycle and we want to know if the two processes differ. The weight is important so we measure 5 tubes from each process. After checking the found the variances are not equal (or suspected to be difference due to an improvement in the process).The data follows:

The means are X-bar₁ = 3.127 and X-bar₂ = 3.113, s₁ = 0.0057 and s₂ = 0.0115. The five samples from each process provides degrees-of-freedom of

The degrees of freedom used to determine the critical value is DF = 5.83 = 5

which rounded down provides an increase to the confidence level.

The critical value is t_{0.05, 5} = 2.571 given an α = 0.05 or a 95% confidence level.

test statistic is

$$ \large\displaystyle t=\frac{3.127-3.113}{\sqrt{\frac{{{\left( 0.0057 \right)}^{2}}}{5}+\frac{{{\left( 0.0115 \right)}^{2}}}{5}}}=2.440$$

Since 2.571(critical value) is larger than 2.440 and in the rejection region, the null hypothesis is rejected. This means there is convincing evidence the two process do not create the same weight fork tubes.

Related:

equal variance hypothesis (article)

Hypothesis Tests for Variance Case I (article)

Two samples variance hypothesis test (article)