Confidence interval for Diagnostic Accuracy (sensitivity and specificity)Hello,
Medical devices company oftenly use Diagnostic Accuracy (sensitivity and specificity) to evaluate their devices.
During the R&D process and later at V&V (verification and validation) they have to provide the confidence interval using the Wislon score method
as recomended by FDA.
An add-in Performance Summary Add-in currently exist that provide such CI however a hard copy would be beneficial as regulatory bodies will not accept a result from an add-in without extensive validation following 21 CFR part 11.
Emmanuel (former Beckman-Coulter employee)
Statistics and AnalyticsRe: Confidence interval for Diagnostic Accuracy (sensitivity and specificity) - Status changed to: In Development@Emmanuel_Romeu, this should appear in the Decision Threshold as hidden columns under Metrics in JMP 17 EA2 (out in August, 2021). Decision Threshold has been added to individual modeling platforms, along with Model Comparison and Model Screening.
Re: Confidence interval for Diagnostic Accuracy (sensitivity and specificity)Thanks for posting Emmanuel, and for commenting Karen.
Anyone else have thoughts/suggestions on this?
Re: Confidence interval for Diagnostic Accuracy (sensitivity and specificity)I wrote this add-in a number of years ago now as a solution to a specific set of measure that I needed frequently and could only get out of the distribution platform (utilizing a table of counts with frequencies). Adding the ability to get performance CI metrics from the new decision thresholds would be one place to add in CI. A more general location would be in contingency tables. It would take some thought as to how to implement...row CI, Column CI, overall CI?? I would want the score CI as in distribution.
