Accendo Reliability

Your Reliability Engineering Professional Development Site

  • Home
  • About
    • Contributors
    • About Us
    • Colophon
    • Survey
  • Reliability.fm
  • Articles
    • CRE Preparation Notes
    • NoMTBF
    • on Leadership & Career
      • Advanced Engineering Culture
      • ASQR&R
      • Engineering Leadership
      • Managing in the 2000s
      • Product Development and Process Improvement
    • on Maintenance Reliability
      • Aasan Asset Management
      • AI & Predictive Maintenance
      • Asset Management in the Mining Industry
      • CMMS and Maintenance Management
      • CMMS and Reliability
      • Conscious Asset
      • EAM & CMMS
      • Everyday RCM
      • History of Maintenance Management
      • Life Cycle Asset Management
      • Maintenance and Reliability
      • Maintenance Management
      • Plant Maintenance
      • Process Plant Reliability Engineering
      • RCM Blitz®
      • ReliabilityXperience
      • Rob’s Reliability Project
      • The Intelligent Transformer Blog
      • The People Side of Maintenance
      • The Reliability Mindset
    • on Product Reliability
      • Accelerated Reliability
      • Achieving the Benefits of Reliability
      • Apex Ridge
      • Field Reliability Data Analysis
      • Metals Engineering and Product Reliability
      • Musings on Reliability and Maintenance Topics
      • Product Validation
      • Reliability by Design
      • Reliability Competence
      • Reliability Engineering Insights
      • Reliability in Emerging Technology
      • Reliability Knowledge
    • on Risk & Safety
      • CERM® Risk Insights
      • Equipment Risk and Reliability in Downhole Applications
      • Operational Risk Process Safety
    • on Systems Thinking
      • Communicating with FINESSE
      • The RCA
    • on Tools & Techniques
      • Big Data & Analytics
      • Experimental Design for NPD
      • Innovative Thinking in Reliability and Durability
      • Inside and Beyond HALT
      • Inside FMEA
      • Institute of Quality & Reliability
      • Integral Concepts
      • Learning from Failures
      • Progress in Field Reliability?
      • R for Engineering
      • Reliability Engineering Using Python
      • Reliability Reflections
      • Statistical Methods for Failure-Time Data
      • Testing 1 2 3
      • The Manufacturing Academy
  • eBooks
  • Resources
    • Accendo Authors
    • FMEA Resources
    • Glossary
    • Feed Forward Publications
    • Openings
    • Books
    • Webinar Sources
    • Podcasts
  • Courses
    • Your Courses
    • Live Courses
      • Introduction to Reliability Engineering & Accelerated Testings Course Landing Page
      • Advanced Accelerated Testing Course Landing Page
    • Integral Concepts Courses
      • Reliability Analysis Methods Course Landing Page
      • Applied Reliability Analysis Course Landing Page
      • Statistics, Hypothesis Testing, & Regression Modeling Course Landing Page
      • Measurement System Assessment Course Landing Page
      • SPC & Process Capability Course Landing Page
      • Design of Experiments Course Landing Page
    • The Manufacturing Academy Courses
      • An Introduction to Reliability Engineering
      • Reliability Engineering Statistics
      • An Introduction to Quality Engineering
      • Quality Engineering Statistics
      • FMEA in Practice
      • Process Capability Analysis course
      • Root Cause Analysis and the 8D Corrective Action Process course
      • Return on Investment online course
    • Industrial Metallurgist Courses
    • FMEA courses Powered by The Luminous Group
    • Foundations of RCM online course
    • Reliability Engineering for Heavy Industry
    • How to be an Online Student
    • Quondam Courses
  • Calendar
    • Call for Papers Listing
    • Upcoming Webinars
    • Webinar Calendar
  • Login
    • Member Home
  • Barringer Process Reliability Introduction Course Landing Page
  • Upcoming Live Events
You are here: Home / Articles / Stability Studies and Estimating Shelf Life with Regression Models

by Steven Wachs Leave a Comment

Stability Studies and Estimating Shelf Life with Regression Models

Stability Studies and Estimating Shelf Life with Regression Models

Stability studies are used to understand and model the degradation of key product characteristics over time.  They are often used to determine the product’s shelf life (the length of time a product may be stored without becoming unfit for use or consumption).

Shelf-Life studies should identify the potential “failure modes” and how they will assessed/ measured.  Examples of characteristics that are measured often include appearance attributes, texture, taste, microbial counts, and product effectiveness/performance.

In this article, we look at shelf-life determination when we are focused on a primary failure mode that will likely occur first.  In a future article, we will look at alternative methods that enable the shelf-life determination to account for multiple possible failure modes (competing risks).  

Defining Fitness for Use

To be fit for use, a product should meet defined specification limits or satisfy other criteria for an acceptable product.  The assessment may be objective (measureable with capable measurement system) or subjective (subject to differences of opinion).  Shelf life is often based on a specified proportion of the product considered to be unfit (e.g. When 5% of the product is expected to be non-conforming).  Note that 0% is not an option since we are dealing with continuous probability distributions.  This selected proportion depends on the risks involved.  

It is not recommended to determine shelf-life based on observing a statistical difference from baseline.  Statistical differences may not be practically significant, and the determination of a statistical difference is a function of sample size.  The shelf-life should reflect practical differences in the product performance that make it unfit for use.  

Also, because all estimates have uncertainty, we typically assign a specified confidence level (e.g. 95%, 99%) to a shelf-life estimate.  This is typically a one-sided bound so that we can say that the shelf life is at leastsome lower bound estimate (on the time scale) with a specified confidence. 

Stability Study under Normal Conditions with Regression Models to Predict Shelf Life

Here we monitor and measure degradation over time (but not necessarily to failure) and use a mathematical model to predict shelf life (via extrapolation in time).  Note that the extrapolation adds uncertainty to the shelf-life prediction.

Stability studies assess and model the degradation of product characteristics over time.  Units/Samples are measured over time (quantitative measurements).  A statistical model (regression) can be fit to the data and extrapolation may be performed to estimate the shelf life (based on a defined specification limit and shelf-life criteria).  The specification limit refers to the minimum or maximum acceptable value.

Standard Regression models predict how the mean of a normally distributed characteristic changes as a function of one or more predictors.  For example, the simple linear regression model below predicts how the average score on a standardized test decreases as the hours of TV watching per week increases

xy plot of TV hours vers Score showing a negative linear relationship

Example: Predicting Shelf Life from Stability Data

Now let’s consider using stability data to predict shelf life.  We assume that insufficient time exists to test/age the product until failure.  Regression models will be utilized to predict the shelf life (by extrapolating).  

5 Samples of a chemical (that degrades over time) are measured over time.  As degradation occurs, the measured values get larger.  If the measured value exceeds 50, the product is considered to be unfit for use (Thus 50 is the upper specification limit).  The data is shown below.

a table of data with columns of C! Time, C2 Measurement and C3-T Sample

Next, we fit a regression line (for the mean) to the measurement data vs. time.  We have also included the upper 95% confidence bound for the regression line.  Based on this model, we are 95% confident that half of the products will still be fit for use at a time of 880.  This is shown on the Shelf-Life Plot below.  Note that the Simple Linear regression procedure assumes that data at each time point are normally distributed so the mean and median (50th percentile) are the same value.  

The Shelf Life Plot of time vs Measurement indicating a shelf life of 879.638

Typically, we would base a shelf-life estimate using a percentile other than 50% so that only a relatively small proportion would be non-conforming at the shelf-life time.  Below is a regression model showing the 90thpercentile regression line along with its 95% upper confidence bound.  

shelf life plot of time vs meaurement with only the upper 90th percentiale, indicating a shelf life of 796.861

So, the time (shelf-life) at which we are 95% confident that at least 90% of the responses are below the upper specification limit of 50 is 797.  If we want to ensure more than 90% are conforming, then we will have an even lower shelf-life time.  

Model Diagnostics

The standard regression procedure has several assumptions.  The key ones are:

  • The response values at each level of the predictor follow a normal distribution
  • The variance of the responses is constant across the range of predictor values
  • The response values are independent of each other

These assumptions are normally verified graphically using residual plots (an example is shown below). 

four different plots of residuals for measurement, including the normal probability plot, residuals vs fitted, a histogram, and run plot of residuals in observation order

Other Situations

The above simple example was straight-forward since the simple linear regression model adequately described the data.  More complex situations arise in practice such as:

  • Non-linear relationships between the response values and time.  The degradation may accelerate or decelerate over time leading to the need for a non-linear model to adequately describe the data.
  • Multiple degradation/failure modes that exist, any of which could cause the product to become unfit for use.  In this case, more traditional reliability methods may be used to estimate the shelf life after first estimating the system reliability (or failure probability) after accounting for all possible failure modes. 
  • Accounting for the impact of lot-to-lot or batch-to-batch variation on the shelf life.  This is common in the pharmaceutical industry.  Ideally data from different lots may be combined to produce a single shelf life estimate from all the data but only if the batches are shown to be homogeneous.  If the batches are non-homogeneous, we base the shelf-life estimate on the worst-case batch. 
  • When accelerated test conditions are necessary to observe failures or degradation leading to failure.  In this case, an accelerated life test model must also be developed to relate failure times at accelerated conditions to expected failure times at normal use conditions

These more complex situations are covered in detail in our training courses.  

Issues and Guidelines for Shelf-Life Estimation

Finally, we provide some guidelines for shelf-life estimation.

  • Shelf-Life estimates based on model extrapolations (over time and/or stress levels) should be validated with longer term testing.  Extrapolation presents a risk that the fitted model may not hold throughout the extrapolation range.  The greater the extrapolation the greater the uncertainty in the estimates.
  • Sensitivity Analysis (impact of varying the fitted model) should be performed.  This gives us an idea of how much our resulting estimates change if we specify other plausible models. 
  • Product specimens should be chosen to reflect the maximum potential production variability (e.g. multiple lots, batches, production conditions, etc.)
  • Sample Sizes needed to produce useful information depend on the method(s) utilized, eventual models specified, etc.  Analytical methods are available to support sample size determination.
  • Sampling frequency and times will depend on the method utilized (e.g. testing until failure observed vs. predicting failure times via model extrapolation)

Summary

This article focused on the use of regression modeling to estimate a product’s shelf-life.  The process involves first defining fitness for use for the product and the parameters for the shelf life statement (proportion meeting specification and confidence level).  The emphasis was on the basic procedure when Simple Linear Regression with a linear model adequately describes the data and when the stability measurements are made under normal use/storage conditions.  We also assumed only a single degradation characteristic determines the shelf-life.

[ninja_form id=419]

Filed Under: Articles, Integral Concepts, on Tools & Techniques

About Steven Wachs

Steven Wachs has 25 years of wide-ranging industry experience in both technical and management positions. Steve has worked as a statistician at Ford Motor Company where he has extensive experience in the development of statistical models, reliability analysis, designed experimentation, and statistical process control.

« Fixing the ISO9001 Quality Problem
ALT or Durability Test? »

Leave a Reply Cancel reply

Your email address will not be published. Required fields are marked *

Articles by Steven Wachs, Integral Concepts
in the Integral Concepts article series

Join Accendo

Receive information and updates about articles and many other resources offered by Accendo Reliability by becoming a member.

It’s free and only takes a minute.

Join Today

Recent Articles

  • Gremlins today
  • The Power of Vision in Leadership and Organizational Success
  • 3 Types of MTBF Stories
  • ALT: An in Depth Description
  • Project Email Economics

© 2025 FMS Reliability · Privacy Policy · Terms of Service · Cookies Policy