MSA - Key Approach
MSA - Key Approach
Dimension
26-01-2024 Quality Solution 8
Why MSA required?
Defect prevention
Prediction
Statistics SPC
Data
Inspection
Measured
Values
Variation
Measurement
System Bias —
Averages Determined through
“Bias Study”
Measurement System
Variability Variability —
Determined through
“R&R Study”
2 2 2
total product measurement
ACCURACY PRECISION
• Closeness to reference • Ability of MS to repeat
or master value the same reading
• Required where two or • Required where MS is
more MS measuring a repeatedly used to
same characteristic assess and adjust the
• Same parameters are process
checked at Suppliers end • In process inspection as
or at Customer end per control plan
Measurement is Measurement is
accurate but not precise but not
precise accurate
Measurement is accurate
and precise
26-01-2024 Quality Solution 19
ACCURACY & PRECISION
ACCURACY PRECISION
Captured by Captured by
• BIAS • REPEATABILITY
• LINEARITY • REPRODUCIBILITY
• STABILITY
Accuracy Linearity
Measurement
System Stability
Variation
Repeatability
Precision
Reproducibility
True Observed
Value Average
n max xi min xi
xi repeatability d 2*
i 1
X
*
where d 2 is taken from Appendix C
n with g = 1 and m = n
b r
n
2
Bias σ b t , 1 zero Bias σ b t , 1
2
3
Frequency
max xi min xi
Reference
Bias
Value = 6.00
1 5.8 -0.2
2 5.7 -0.3 repeatability d 2*
3 5.9 -0.1
T 4 5.9 -0.1
R 5 6.0 0.0
6.4 5.6
I 6 6.1 0.1
.2254
A
L
7
8
6.0
6.1
0.0
0.1
3.55
S 9 6.4 0.4
10 6.3 0.3
b r
.2254
.0582
11 6.0 0.0
12 6.1 0.1
n = 15 13 6.2 0.2 n 15
14 5.6 -0.4
15 6.0 0.0 bias .0067
t .1151
b .0582
n
xi 90.1
i 1
X 6.0067
n 15
2
Bias σ b t , 1 zero Bias σ b t , 1
2
.1186 0 .1320
Non-Linearity
Gauge is measuring lower
than true value at high end
Measured Value
Reference Value
PART 1 2 3 4 5
REFERENCE 4.00 6.00 8.00 10.00
2.00
VALUE
1 0.7 1.1 -0.2 -0.4 -0.9 -1
B 2 0.5 -0.1 -0.3 -0.3 -0.7
3 0.4 0.2 -0.1 -0.2 -0.5 2 3 4 5 6 7 8 9 10
I 4 0.5 1 -0.1 -0.3 -0.7
reference values
5 0.7 -0.2 0.0 -0.2 -0.6
A 6 0.3 -0.1 0.1 -0.2 -0.5
Regression
7 0.5 -0.1 0.0 -0.2 -0.5
S 8 0.5 -0.1 0.1 -0.3 -0.5
95% Cl
9 0.4 -0.1 0.4 -0.2 -0.4
10 0.4 0.0 0.3 -0.5 -0.8 Bias Average
11 0.6 0.1 0.0 -0.4 -0.7
12
BIAS AVG
0.4
0.491667
-0.2
0.125
0.1
0.025
-0.3
-0.29167
-0.6
-0.61667
Linearity Study - Graphical Analysis
•Do not worry about calculations , you can use Minitab to help you
26-01-2024 •Consult with your Black Belt expert for further guidance
Quality Solution 38
Stability
Stability
Time Time
1 2
6.2
6.1
6.0 6.021
5.9
5.8
LCL=5.746
5.7
Subgroup 0 10 20
1.0 UCL=1.010
Sample Range
0.5 0.4779
0.0 LCL=0
Repeatability
Operator Operator
1 2
Adequate Resolution
There is enough resolution
in the measurement device
X so that the product can
X have many different values.
X X
X X X
X X X X
X X X X X
5.1 5.2 5.3 5.4 5.5
• Total variation
• Manufacturing process variation
• Part to part variation
• Within part variation
• Measurement system variation
• Appraiser variation
• Equipment variation
• Appraiser part interaction
Repeatability Reproducibility
• Same Equipment • Same equipment
• Same parts •Same Parts
•Several trials •Several trials
• One Appraiser •Different Appraiser
Being the Short study this can be used for Periodic verification of
R&R to detect any changes rather than average range method
_
_
UCL=0.8796
0.8 X=0.8075
LCL=0.7354
0.6
0.4
R Chart by Operator
1 2 3
0.12 UCL=0.1252
Sample Range
0.08
_
0.04 R=0.0383
0.00 LCL=0
CONDITION INTERPRETATION
• One or more than one • His method is different
point of one appraiser from others
out of UCL R • Measurement System is
• One or more than one sensitive to appraisers
point of all appraisers skill
out of UCL R • Part is deformed or
• In one part all Damaged
appraisers points are
out of UCL R
• Example
PT1 PT2 PT3 PT4 PT5 PT6 PT7 PT8 PT9 PT10 AP/TRIAL
0.65 1.00 0.85 0.85 0.55 1.00 0.95 0.85 1.00 0.60 A1
0.60 1.00 0.80 0.95 0.45 1.00 0.95 0.80 1.00 0.70 A2
0.55 1.05 0.80 0.80 0.40 1.00 0.95 0.75 1.00 0.55 B1
0.55 0.95 0.75 0.75 0.40 1.05 0.90 0.70 0.95 0.50 B2
0.50 1.05 0.80 0.80 0.45 1.00 0.95 0.80 1.05 0.85 C1
0.55 1.00 0.80 0.80 0.50 1.05 0.95 0.80 1.05 0.80 C2
66
Gage R&R Study for Thickness – XBar/R Method
67
Calculation Explanation
May be Acceptable
10 – 30%
Probably Not Acceptable
>30%
K Pr(agreement) Pr(error)
1 Pr(error)
85
ATTRIBUTE GAGE CALCULATIONS FOR “COUNTS”
86
ATTRIBUTE GAGE CALCULATIONS FOR “COUNTS”
Part A-1 A -2 A-3 B- 1 B-2 B-3 C-1 C-2 C-3 Reference
1 1 1 1 1 1 1 1 1 1 1
2 1 1 1 1 1 1 1 1 1 1
3 0 0 0 0 0 0 0 0 0 0
4 0 0 0 0 0 0 0 0 0 0
5 0 0 0 0 0 0 0 0 0 0
6 1 1 0 1 1 0 1 0 0 1
7 1 1 1 1 1 1 1 0 1 1
8 1 1 1 1 1 1 1 1 1 1
9 0 0 0 0 0 0 0 0 0 0
10 1 1 1 1 1 1 1 1 1 1
11 1 1 1 1 1 1 1 1 1 1
12
13
0
1
0
1
0
1
0
1
0
1
0
1
0
1
1
1
0
1
0
1 • There are 31 times where
14
15
16
1
1
1
1
1
1
0
1
1
1
1
1
1
1
1
1
1
1
1
0
1
1
0
1
1
1
1
1
A-3 = 1 and B-3 = 1
(that is of the 50 parts checked there
1 1
17 1 1 1 1 1 1 1 1 1 1
18 1 1 1 1 1 1 1 1 1 1
19
20
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1
1 were 31 matches by A and B on their
THIRD check)
21 1 1 0 1 0 1 0 1 0 1
22 0 0 1 0 1 0 1 1 0 0
23 1 1 1 1 1 1 1 1 1 1
24 1 1 1 1 1 1 1 1 1 1
25 0 0 0 0 0 0 0 0 0 0
26 0 1 0 0 0 0 0 0 1 0
27 1 1 1 1 1 1 1 1 1 1
28 1 1 1 1 1 1 1 1 1 1
29 1 1 1 1 1 1 1 1 1 1
30 0 0 0 0 0 1 0 0 0 0
31 1 1 1 1 1 1 1 1 1 1
32 1 1 1 1 1 1 1 1 1 1
33 1 1 1 1 1 1 1 1 1 1
34 0 0 1 0 0 1 0 1 1 0
35 1 1 1 1 1 1 1 1 1 1
= 34+32+31= 97
39 0 0 0 0 0 0 0 0 0 0
40 1 1 1 1 1 1 1 1 1 1
41 1 1 1 1 1 1 1 1 1 1
42 0 0 0 0 0 0 0 0 0 0
43 1 0 1 1 1 1 1 1 0 1
44 1 1 1 1 1 1 1 1 1 1
45 0 0 0 0 0 0 0 0 0 0
46 1 1 1 1 1 1 1 1 1 1
47 1 1 1 1 1 1 1 1 1 1
48 0 0 0 0 0 0 0 0 0 0
49 1 1 1 1 1 1 1 1 1 1
50 0 0 0 0 0 0 0 0 0 0
87
Hypothesis Test Analyses
A * B Crosstabulation
B
.00 1.00 Total
A .00 Count 44 6 50
Expected Count 15.7 34.3 50.0
1.00 Count 3 97 100
Expected Count 31.3 68.7 100.0
Total Count 47 103 150
Expected Count 47.0 103.0 150.0
A * B Crosstabulation
B
.00 1.00 Total
A .00 Count 44 6 50
Expected Count 15.7 34.3 50.0
1.00 Count 3 97 100
Expected Count 31.3 68.7 100.0
Total Count 47 103 150
Expected Count 47.0 103.0 150.0
The expected counts is calculated using the the following formula (based on Chi-
Square)
B
.00 1.00 Total
A .00 Count 44 6 50
Expected Count 15.7 34.3 50.0
1.00 Count 3 97 100
Expected Count 31.3 68.7 100.0
Total Count 47 103 150
Expected Count 47.0 103.0 150.0
po pe
kappa
1 pe
where po = Sum of the observed proportions in the diagonal cells (left to right direction)
pe = Sum of the expected proportions in the diagonal cells (left to right direction)
po 4497 0.94 pe 15.7 68.7 0.56
150 150
po pe 0.94 0.56
kappa 0.86
1 pe 1 0.56
91
Miss Rate & False Alarm Rate For Appraiser “A”
• Operator Training
• Clarification of Standards
• Simplification of Standards
• Conversion to Variable Data
SSTotal y y y
2 y2
2
n
Strictly speaking the sum of squares column is the sum of
squares around the mean, known as the corrected sum of
squares. We always use the corrected sum of squares when
estimating variation.
y 0.65 0.60 1.00 1.00 ............. 0.80 48.45
y 2
0 .65 2
0 .60 2
1 .00 2
1 .00 2
.......... . 0. 80 2
41.3725
SSTotal y
2 y
2
41.3725
48.45
2
41.3725 39.1234 2.2491
n 60
P P P ......... P y
2 2 2 2 2
SS Part 1 2 3
10
np n
SS Part
3.40 6.05 4.80 ......... 4.00 48.45
2 2 2 2
2
6 60
O O O y
2 2 2 2
SS Operator 1 2
3
no n
SS Operator
16.55 15.35 16.55 48.45
2 2 2
2
20 60
SSOperatorPart
1.25 2.00 ........1.65 48.45
2 2 2
2
0.0480 2.0587
2 60
Where:
O1P1, O1P2,…….O3P10 are the Sums for each Operator & Part Combination
i.e the sum of the 2 measurements made by each operator on each part.
nOxP is the number of measurements made by each operator on each part.
Total 2.2491
Person 1 v Person 2
Tallest v Person 3
Total 2.2491 59
Total 2.2491 59
Total 2.2491 59
2 0.00225
Operator X Part
26-01-2024 Quality Solution 110
Source Mean Square
ExpectedofMean
Estimating Components Square
Variation
Parts 0.2287
Operators 0.0240
6 2 2 2 2
Operator x Part 0.0058
Part Operator Part Repeatability
Repeatability 0.0013
20 2 2 2 2
Operator Operator Part Repeatability
2 2 2
Operator Part Repeatability
2
Repeatability
20 2 2 2 2 0 . 0240
Operator Operator Part Repeatability
20 2 0 . 0240 2 2 2
Operator Operator Part Repeatability
0.00240-2(0.00225)-0.0013 0.0091
2
Operator 20
2
Part 0.002287-2(0.00225)-0.0013 0.03715
6
26-01-2024 Quality Solution 112
Estimating Components of Variation
0.03715
2
Part
2
Operator
0.00091
2
Part
Operator
0.00225
2Repeatability 0.00130
2
Total 2Part Operator
2
Operator
2
Part 2
Repeatability
2
Total 0.037150.000910.002250.001300.04161
We have established estimates of each of the components of
variation!