Accendo Reliability

Your Reliability Engineering Professional Development Site

  • Home
  • About
    • Contributors
    • About Us
    • Colophon
    • Survey
  • Reliability.fm
  • Articles
    • CRE Preparation Notes
    • NoMTBF
    • on Leadership & Career
      • Advanced Engineering Culture
      • ASQR&R
      • Engineering Leadership
      • Managing in the 2000s
      • Product Development and Process Improvement
    • on Maintenance Reliability
      • Aasan Asset Management
      • AI & Predictive Maintenance
      • Asset Management in the Mining Industry
      • CMMS and Maintenance Management
      • CMMS and Reliability
      • Conscious Asset
      • EAM & CMMS
      • Everyday RCM
      • History of Maintenance Management
      • Life Cycle Asset Management
      • Maintenance and Reliability
      • Maintenance Management
      • Plant Maintenance
      • Process Plant Reliability Engineering
      • RCM Blitz®
      • ReliabilityXperience
      • Rob’s Reliability Project
      • The Intelligent Transformer Blog
      • The People Side of Maintenance
      • The Reliability Mindset
    • on Product Reliability
      • Accelerated Reliability
      • Achieving the Benefits of Reliability
      • Apex Ridge
      • Field Reliability Data Analysis
      • Metals Engineering and Product Reliability
      • Musings on Reliability and Maintenance Topics
      • Product Validation
      • Reliability by Design
      • Reliability Competence
      • Reliability Engineering Insights
      • Reliability in Emerging Technology
      • Reliability Knowledge
    • on Risk & Safety
      • CERM® Risk Insights
      • Equipment Risk and Reliability in Downhole Applications
      • Operational Risk Process Safety
    • on Systems Thinking
      • Communicating with FINESSE
      • The RCA
    • on Tools & Techniques
      • Big Data & Analytics
      • Experimental Design for NPD
      • Innovative Thinking in Reliability and Durability
      • Inside and Beyond HALT
      • Inside FMEA
      • Institute of Quality & Reliability
      • Integral Concepts
      • Learning from Failures
      • Progress in Field Reliability?
      • R for Engineering
      • Reliability Engineering Using Python
      • Reliability Reflections
      • Statistical Methods for Failure-Time Data
      • Testing 1 2 3
      • The Manufacturing Academy
  • eBooks
  • Resources
    • Accendo Authors
    • FMEA Resources
    • Glossary
    • Feed Forward Publications
    • Openings
    • Books
    • Webinar Sources
    • Podcasts
  • Courses
    • Your Courses
    • Live Courses
      • Introduction to Reliability Engineering & Accelerated Testings Course Landing Page
      • Advanced Accelerated Testing Course Landing Page
    • Integral Concepts Courses
      • Reliability Analysis Methods Course Landing Page
      • Applied Reliability Analysis Course Landing Page
      • Statistics, Hypothesis Testing, & Regression Modeling Course Landing Page
      • Measurement System Assessment Course Landing Page
      • SPC & Process Capability Course Landing Page
      • Design of Experiments Course Landing Page
    • The Manufacturing Academy Courses
      • An Introduction to Reliability Engineering
      • Reliability Engineering Statistics
      • An Introduction to Quality Engineering
      • Quality Engineering Statistics
      • FMEA in Practice
      • Process Capability Analysis course
      • Root Cause Analysis and the 8D Corrective Action Process course
      • Return on Investment online course
    • Industrial Metallurgist Courses
    • FMEA courses Powered by The Luminous Group
    • Foundations of RCM online course
    • Reliability Engineering for Heavy Industry
    • How to be an Online Student
    • Quondam Courses
  • Calendar
    • Call for Papers Listing
    • Upcoming Webinars
    • Webinar Calendar
  • Login
    • Member Home
  • Barringer Process Reliability Introduction Course Landing Page
  • Upcoming Live Events
You are here: Home / Articles / Hypothesis Test Sample Size

by Fred Schenkelberg Leave a Comment

Hypothesis Test Sample Size

Hypothesis Test Sample Size

Hypothesis testing permits us to compare two groups of items and determine if there is a significant difference or not. There are many types of hypothesis tests depending on the specific question, type of data, and what is or is not known when designing the test.

One of the most often asked question concerning nearly any testing is the sample size. There are times, although sometimes rare, when we have sufficient samples to run the test properly – statistically speaking. Whether we have ample samples or not, we should calculate the sample size related to the desired confidence.

The α error that can be tolerated should be set by local policy (if not, select a reasonable number at or below 0.4, common is 0.1 which is related to a 90% Type-1 confidence.) The next bit of information you need is how much of a difference is desired that the test actually detects. For example, if we are considering heights of people (for some reason) we may want to know if a specific group’s average height is at least 6 inches less than the overall population. Thus if the two groups of data are at least 6 inches different the test is designed to be able to detect that difference. The last bit of information we need is the variation of the data (standard deviation either known or estimated).

Given that we’ve selected a particular hypothesis test to run, and we’ve collected the three bits of information we need, we can calculate the minimum number of samples needed for the hypothesis test. Let’s assume we’re using a Z-test for a hypothesis about the means.

$$ \large\displaystyle Z=\frac{\bar{X}-\mu }{{}^{\sigma }\!\!\diagup\!\!{}_{\sqrt{n}}\;}$$

Z as you recall the test statistic and compared to a critical value for the decision at hand.

The X-bar minus μ is the data average difference from the population mean. In our planning stage, this is the amount of difference we would like to be able to detect with the test. For the height example above, this would be 6 inches. Let’s change the notation by stating the difference as E.

$$ \large\displaystyle E=\bar{X}-\mu $$

E is the minimum difference of interest. Next, let’s isolate the n term with some simple algebra.

$$ \large\displaystyle \sqrt{n}=\frac{Z\sigma }{E}$$

and, square both sides to finish.

$$ \large\displaystyle n=\frac{{{Z}^{2}}{{\sigma }^{2}}}{{{E}^{2}}}$$

Continuing our example of heights, let’s use E = 6, σ=6, and we’d like at least 95% confidence making α=0.05 and Z=1.96. Insert the values a little math, and we find the sample size.

$$ \large\displaystyle n=\frac{{{1.96}^{2}}{{6}^{2}}}{{{6}^{2}}}=3.84\approx 4$$

In this simple example, the standard deviation and difference of interest at the same and cancel out making the calculation very easy. We need a sample of four from the group to determine if that group’s average height is 6 inches lower or not than the population.

If we wanted higher confidence notice that Z increases rapidly. Also, if we wanted to detect less of a difference, again sample size increases rapidly as we want to detect a smaller difference, approaching infinity as the difference approaches zero. And, if the population has a higher variation than this example, again the sample size goes up.

Ideally, we always want to work with populations with very small amount of variation, relative low confidence (although many argue for at least 80 to 95% confidence as acceptable), and the desire to detect very large differences. Of course, this is often not the case. This sample size formula permits you to work with your team to balance the test cost, sample size, confidence, and sensitivity (E) of the planned test.

One can start with any hypothesis test and with some ‘rearrangement’ determine the sample size formula for that test. For those preparing for the CRE exam to work though a few of these and have the formulas in your notes.


Related:

Hypothesis Testing (article)

Paired-Comparison Hypothesis Tests (article)

Sample Size – success testing (article)

 

Filed Under: Articles, CRE Preparation Notes, Probability and Statistics for Reliability Tagged With: Hypothesis testing, Sample size

About Fred Schenkelberg

I am the reliability expert at FMS Reliability, a reliability engineering and management consulting firm I founded in 2004. I left Hewlett Packard (HP)’s Reliability Team, where I helped create a culture of reliability across the corporation, to assist other organizations.

« Reliability Centered Maintenance
MTBF and preventative maintenance »

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

CRE Preparation Notes

Article by Fred Schenkelberg

Join Accendo

Join our members-only community for full access to exclusive eBooks, webinars, training, and more.

It’s free and only takes a minute.

Get Full Site Access

Not ready to join?
Stay current on new articles, podcasts, webinars, courses and more added to the Accendo Reliability website each week.
No membership required to subscribe.

[popup type="" link_text="Get Weekly Email Updates" link_class="button" ][display_form id=266][/popup]

  • CRE Preparation Notes
  • CRE Prep
  • Reliability Management
  • Probability and Statistics for Reliability
  • Reliability in Design and Development
  • Reliability Modeling and Predictions
  • Reliability Testing
  • Maintainability and Availability
  • Data Collection and Use

© 2025 FMS Reliability · Privacy Policy · Terms of Service · Cookies Policy