Purpose <p>This study introduces <i>Inf.P,</i> a novel method for determining optimal cut-off points using the inflection point approach in the absence of a gold standard. It models the nonlinear relationship between raw scores and latent class probabilities with a cubic polynomial function, offering a data-driven boundary that reflects the underlying latent structure. Inf.P enhances diagnostic precision of scale-based assessments by providing more accurate thresholds for distinguishing different levels of latent attributes.</p> Methods <p>To evaluate the <i>Inf.P</i>, high- and low-attribute groups were created for benchmarking. The method was compared to the traditional Youden Index through a comprehensive simulation study, exploring variations in sample sizes and item numbers. Real-world data were also employed to assess its applicability. Performance was assessed using accuracy, bias, and mean squared error (MSE).</p> Results <p>The <i>Inf.P</i> method demonstrated lower bias and MSE compared to the Youden Index, especially when specificity was prioritized. Both methods yielded similar accuracy in larger samples, but <i>Inf.P</i> provided more reliable cut-off points. In smaller samples, the difference between estimated cut-off points increased with the number of items but decreased in larger samples. These findings suggest that studies with small sample sizes should consider limiting the number of items to maintain optimal cut-off precision.</p> Conclusion <p>Inf.P offers a robust and reliable approach for defining optimal cut-off in scale-based assessments of complex latent traits, supported by real data, with an interactive web tool available for practical use (<a href="https://spapp.shinyapps.io/InfPcutoff/">https://spapp.shinyapps.io/InfPcutoff/</a>). It promises to enhance diagnostic accuracy and clinical decision-making, particularly in the assessment of psychological and neurological disorders, as well as in determination of quality of life.</p>

错误:搜索内容不能为空,请输入英文关键词
错误:关键词超出字数限制,请精简
高级检索

Defining an optimal cut-off for subscales without a gold standard: a novel method using inflection points of latent attribute probabilities and raw scores

  • Pervin Demir,
  • Selcen Yüksel

摘要

Purpose

This study introduces Inf.P, a novel method for determining optimal cut-off points using the inflection point approach in the absence of a gold standard. It models the nonlinear relationship between raw scores and latent class probabilities with a cubic polynomial function, offering a data-driven boundary that reflects the underlying latent structure. Inf.P enhances diagnostic precision of scale-based assessments by providing more accurate thresholds for distinguishing different levels of latent attributes.

Methods

To evaluate the Inf.P, high- and low-attribute groups were created for benchmarking. The method was compared to the traditional Youden Index through a comprehensive simulation study, exploring variations in sample sizes and item numbers. Real-world data were also employed to assess its applicability. Performance was assessed using accuracy, bias, and mean squared error (MSE).

Results

The Inf.P method demonstrated lower bias and MSE compared to the Youden Index, especially when specificity was prioritized. Both methods yielded similar accuracy in larger samples, but Inf.P provided more reliable cut-off points. In smaller samples, the difference between estimated cut-off points increased with the number of items but decreased in larger samples. These findings suggest that studies with small sample sizes should consider limiting the number of items to maintain optimal cut-off precision.

Conclusion

Inf.P offers a robust and reliable approach for defining optimal cut-off in scale-based assessments of complex latent traits, supported by real data, with an interactive web tool available for practical use (https://spapp.shinyapps.io/InfPcutoff/). It promises to enhance diagnostic accuracy and clinical decision-making, particularly in the assessment of psychological and neurological disorders, as well as in determination of quality of life.