Table 4 Diagnostic accuracy for identifying PD cases, of judge ratings of staining densities, for each laboratory (DM, TB, JK, AGC/FL) and staining morphology type (LP = lamina propria granular pattern; EC = endothelial cell nuclear pattern; LG = lacy-granular pattern; PV = perivascular-vascular pattern). Results for the average of judge’s ratings as well as the “best” judge’s ratings are shown. Some judges did not rate some staining patterns for some laboratories; results are therefore given for four judges where all judge scores were available and for the three common judges when one or more judge scores were missing. Cases without submucosa in the slide were excluded from results for staining morphologies dependent on the presence of submucosa (DM-PV, AGC/FL-PV, JK-LG). AUC = area under curve
Box 1 DM-LP | Box 1 DM-LPa | Box 2 TB-EC | Box 2 TB-LP | Box 3 JK-LG | Box 3 JK-LGa | Box 4 AGC/FL-EC | Box 4 AGC/FL-LP | Box 4 AGC/FL-LG | |
|---|---|---|---|---|---|---|---|---|---|
N | 12 | 7 | 12 | 12 | 12 | 11 | 12 | 12 | 12 |
Four Raters | |||||||||
AUC | 0.63 | 0.65 | NA | NA | 0.58 | 0.53 | NA | 0.67 | NA |
Sensitivity | 86 % | 83 % | 28 % | 28 % | 89 % | 97 % | NA | 81 % | NA |
Specificity | 25 % | 0 % | 75 % | 83 % | 17 % | 17 % | NA | 33 % | NA |
Youden Index | 0.11 | −0.17 | 0.03 | 0.11 | 0.06 | 0.14 | NA | 0.14 | NA |
Three Raters | |||||||||
AUC | 0.62 | 0.53 | NA | NA | 0.58 | 0.51 | 0.71 | 0.67 | 0.69 |
Sensitivity | 85 % | 78 % | 37 % | 15 % | 89 % | 100 % | 74 % | 74 % | 70 % |
Specificity | 33 % | 0 % | 67 % | 100 % | 11 % | 11 % | 56 % | 22 % | 44 % |
Youden Index | 0.19 | −0.22 | 0.04 | 0.15 | 0.00 | 0.11 | 0.30 | −0.04 | 0.15 |
Best Rater | |||||||||
Rater | DM | JK | JL | JL | JK | DM | JL | JK | DM |
AUC | 0.61 | 1.00 | 0.50 | 0.72 | 0.59 | 0.46 | 0.83 | 0.67 | 0.80 |
Sensitivity | 100 % | 100 % | 78 % | 44 % | 89 % | 100 % | 67 % | 100 % | 78 % |
Specificity | 33 % | 0 % | 33 % | 100 % | 33 % | 33 % | 100 % | 67 % | 67 % |
Youden Index | 0.33 | 0.00 | 0.11 | 0.44 | 0.22 | 0.33 | 0.67 | 0.67 | 0.44 |