on Systems Thinking

Opinion-based data is the foundation of qualitative assessments. Qualitative assessments are used in various applications, including asset management, risk management, human reliability analysis, and customer surveys. The usefulness of any qualitative assessment is a function of design, analysis, and administration. This article provides three examples of poor qualitative analysis to avoid and, in turn, improve the effectiveness of your work.

Qualitative Assessment Scales

Likert scales are five-point ordinal scales where participants select a label (or numerical value) that equates to an opinion or attitude. Labels are paired (i.e., agree-disagree, strongly agree-strongly disagree) symmetrically around a neutral center. Today, we see 5-, 7-, and 9-point versions of Likert scales in everything from customer surveys to risk assessments.

Opinion-based data is the foundation of qualitative assessments. Qualitative assessments are used in various applications, including asset management, risk management, human reliability analysis, and customer surveys. The usefulness of any qualitative assessment is a function of design, analysis, and administration. The article provides best practices for improving administering and facilitating qualitative assessments.

A Long History with Many Forms

The modern basis of opinion-based data’s scientific use can be traced from the western hemisphere to the late 1800s. Educators and psychologists were seeking to quantify their clinical observations of human behavior. A similar movement was underway in the fields of natural science and statistics.

Opinion-based data is the foundation of qualitative assessments. Qualitative assessments are used in various applications, including asset management, risk management, human reliability analysis, and customer surveys. The usefulness of any qualitative assessment is a function of best practices associated with design, analysis, and administration.

The article provides best practices for improving qualitative assessment analysis. Facilitators develop and use qualitative assessments in the execution of their work. Facilitators should be aware of qualitative assessment analysis as they seek to bring a group of participants to solutions that are created, understood, and accepted by all.

Opinion-based data is the foundation of qualitative assessments. Qualitative assessments are used in various applications, including asset management, risk management, human reliability analysis, and customer surveys. The usefulness of any qualitative assessment is a function of design, analysis, and administration.

The article provides tips for improving qualitative assessment design. Facilitators develop and use qualitative assessments in the execution of their work. Facilitators should be aware of qualitative assessment design as they seek to bring a group of participants to solutions that are created, understood, and accepted by all. [Read more…]

A facilitator leads a group of participants to solutions that are created, understood, and accepted by all. Effective facilitation cannot be achieved without the role of people and social sciences. Understanding Likert scales as a viable technique is necessary to improve qualitative assessments, including risk assessments, condition assessments, and prioritization.

Likert scales were originally developed by Rensis Likert, who was concerned with measuring psychological attitudes and wished to do this in a “scientific” way. Specifically, he sought a method to produce attitude measures that could reasonably be interpreted as measurements on a proper metric scale, such as a thermometer.

There was a lot to unpack from the 45-minute information session. After all, three different governmental units evaluated the issue for over three years. We had not had a debriefing on the issue in a year. And the issue was an emerging one, ripe with complexity and uncertainty. Effective communication can be difficult in these types of information sessions.

[Read more…]

There are a lot of keen insights in the 2022 FINESSE guest articles for improving communication skills. Looking back on this bold collection reminds me that much good work, and systems thinking, is still needed for as we move into the future.

Effective Communication is a System

Is there a single theme that we can gain from the 2022 guest articles that makes it easier to communicate information related to work-related decisions with complexity and uncertainty? Is there one thing we can do to be an effective trusted advisor? The answer to both is “not really.” [Read more…]

Sometimes it is easier to start with what not to do. That is often the case for technically trained professionals who are often not the best natural communicators. Americans with Disabilities Act (ADA) and international standards for the visually and hearing impaired provide good guardrails.

The Basics

These are five basics that should be considered as a minimum standard.

Reliability and systems engineers are in it for the long game. Their work feeds big decisions that take months or years to evaluate and must pass through many levels of management. Big decisions are filled with complexity (many interrelated parts) and uncertainty (unknown beyond doubt or not clearly defined). This article provides several key observations about uncertainty and five tips on how to drive out uncertainty with FINESSE.

Knowledge (and the degree of its validation)

Uncertainty refers to situations involving imperfect or unknown information. It applies to predictions of future events, to physical measurements that are already made, or to the unknown. Uncertainty arises in partially observable environments and is due to ignorance, indolence, or both (Norvig and Thrun).

Technical professionals drive toward collecting more data – more knowledge – but is that really what decision-makers care about?