InsightFab
Knowledge Base/Measurement Tool Selection Guide: Deriving Measurement Tool Capability from Tolerance Requirements
MSA6 min read

Measurement Tool Selection Guide: Deriving Measurement Tool Capability from Tolerance Requirements

This article addresses a common challenge in manufacturing: persistent poor measurement data despite extensive process optimization. The author highlights how inadequate measurement tool selection, rather than process flaws, can lead to dismal Cpk reports. It emphasizes that true measurement capability, not just resolution, is crucial for accurately capturing process variation.

That day the Cpk report came out, the whole room was silent for three seconds

I still remember years ago, when our new process was undergoing trial runs. The Cpk report for the first batch of products came out, and everyone's eyes widened. Cpk 1.08, DPMO 6210! These numbers were practically driving us to a dead end. In the meeting room, everyone's faces were paler than the lights in the cleanroom. The boss's gaze was like an X-ray, scanning the entire room. It was only later that we discovered it wasn't a process issue at all; we had simply chosen the wrong measurement tool from the start, completely failing to capture the true variation! Have you ever had a similar experience? You diligently tune the process, yet the measurement results consistently fall short of expectations?

Where's the Problem?

Simply put, your understanding of "measurement systems" isn't deep enough. Many times, when we see tolerance requirements, we instinctively pick a measurement tool that "seems about right." What's the result? The measurement data ends up being arbitrary, like playing Monopoly and counting whatever space you land on. The most common mistake is focusing solely on the instrument's "Resolution," thinking, "Wow, it can measure to three decimal places, so precise!" but forgetting its true "Capability." High resolution doesn't equate to accuracy; it's like taking a blurry photo with a high-resolution phone – it's still blurry.

Therefore, the key is that when selecting a measurement tool, you must work backward from your "tolerance requirements." If your product tolerance is very small, your measurement tool's capability must be stronger. Conversely, if the tolerance is very loose, you don't need to overdo it by choosing an expensive, overkill measurement tool. This principle is, in fact, the core essence of MSA (Measurement System Analysis).

How to Actually Do It?

The simplest way to judge is by looking at the "Measurement Variation as a Percentage of Tolerance (P/T%)" in your "Gage Repeatability and Reproducibility (GR&R)" report. Frankly, this number determines whether your measurement tool is truly fit for purpose.

  1. P/T% < 10%: Congratulations, this measurement tool performs well and can be used with confidence. Your measurement error has a negligible impact on the tolerance.
  2. 10% < P/T% < 30%: This is awkward. While your measurement tool's capability is still within the "acceptable" range, honestly, this is a yellow light warning. You'll have to be on edge with every measurement, as even slight process variations could lead to incorrect judgments. It's recommended that you start considering improving the measurement tool or method.
  3. P/T% > 30%: You're in big trouble. This measurement tool is completely unsuitable for measuring this product. Your measurement error is too large, to the point where it will make your judgments entirely inaccurate. It's like trying to measure the diameter of a hair with a ruler – you'll completely miss the point. At this stage, no matter how hard you try to adjust the process, seeing incorrect measurement results will only be a wasted effort.

So, next time you receive a product's tolerance requirements, don't rush to find a measurement tool. First, ask yourself, what is this tolerance range? Then, anticipate what your measurement tool's P/T% will likely be.

The Most Common Pitfall

I remember one time, a new engineer had a product with a tolerance of ±0.01mm. He immediately found a measurement tool with 0.001mm resolution, thinking, "Wow, ten times smaller than the tolerance, it must be super accurate!" However, when the GR&R was run, the P/T% was as high as 45%! His face turned green. We later discovered that although the tool had high resolution, its repeatability and reproducibility were extremely poor; the values would jump around every time the same point was measured. This is like buying a TV advertised as 8K, only to feed it a 360p video source – utterly pointless.

So, never look solely at resolution! Resolution is merely a "threshold" for a measurement tool, but its true "capability" depends on its stability, repeatability, and reproducibility.

One Thing You Can Do Today

Find the main measurement tools you are currently using and review their GR&R reports!

Want to try it yourself?

Every tool mentioned in this article is available on InsightFab — just upload a CSV to analyze.

Go to Tools

More in this category

When Gage R&R Exceeds 30%, Your Cpk Is a Lie

After two weeks of process adjustment, Cpk reportedly improved from 0.98 to 1.35. However, if a Measurement System Analysis reveals %GRR to be 38%, then half of the perceived "improvement" might be an illusion caused by measurement error.

Gage R&R: How Truthful Are Your Measurement Tools?

A new engineer measures a part multiple times with slightly different results, while a colleague also gets a different reading. With a specification of ±0.05mm, this might seem acceptable, but is your calculated Cpk of 0.95 truly a process capability issue or primarily due to measurement system error?

NDC: Number of Distinct Categories – Can Your Gage Really Tell the Difference?

Only evaluating %GRR after completing Gage R&R is insufficient. The Number of Distinct Categories (NDC) indicates how many distinct levels a gage can classify products into, critically determining the usability of your measurement system.