CGSSM: Stata module implementing the contrasting groups' standard setting method

Niels Henrik Bruun

Statistical Software Components from Boston College Department of Economics

Abstract: Establishing a competency standard for when a certain level of expertise is reached by identifying cut-off points on different performance measures based on rating scores or simulator metrics is an important issue in competency-based learning. One method to set such standards, is the contrasting groups' standard setting method. It is a participant-based method where the performance of a certain procedure is evaluated between participants of different expertise level, e.g., novices and experts. Using the contrasting groups' method, the cut-off point is set by identifying the intercept of two normally distributed curves that represent the score distributions of the groups defined by their level of expertise. After a pass/fail score is defined, the percentage of false positives and negatives can be calculated to explore the consequences of the test. Traditionally, these false positives and false negatives are calculated based on the observed number of individuals who passes or fails a test. However, validity studies often include only a small number of participants. These small numbers make the rate of false positives and false negatives sensitive to outliers. Instead, using the normally distributed curves that represent the score distributions of the groups defined by their level of expertise, the theoretical false negatives, and theoretical false positives can be calculated. What is new in cgssm and cgssmi is that the cut-off is found using an exact formula based on solving a polynomial of first or second order degree.

Language: Stata
Requires: Stata version 12
Keywords: competency standard; false positive; false negative (search for similar items in EconPapers)
Date: 2023-02-12, Revised 2023-02-21
Note: This module should be installed from within Stata by typing "ssc install cgssm". The module is made available under terms of the GPL v3 (https://www.gnu.org/licenses/gpl-3.0.txt). Windows users should not attempt to download these files with a web browser.
References: Add references at CitEc
Citations:

Downloads: (external link)
http://fmwww.bc.edu/repec/bocode/c/cgssm.ado program code (text/plain)
http://fmwww.bc.edu/repec/bocode/c/cgssm.sthlp help file (text/plain)
http://fmwww.bc.edu/repec/bocode/c/cgssmi.ado program code (text/plain)
http://fmwww.bc.edu/repec/bocode/c/cgssmi.sthlp help file (text/plain)

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:boc:bocode:s459180

Ordering information: This software item can be ordered from
http://repec.org/docs/ssc.php

Access Statistics for this software item

More software in Statistical Software Components from Boston College Department of Economics Boston College, 140 Commonwealth Avenue, Chestnut Hill MA 02467 USA. Contact information at EDIRC.
Bibliographic data for series maintained by Christopher F Baum ().