DESIGN: Retrospective assessment using the Peer Assessment Rating (PAR) index.
SETTING: Consecutive patients treated by one consultant orthodontist at a tertiary care cleft center.
PARTICIPANTS: One hundred twenty-seven patients with either complete unilateral cleft lip and palate (UCLP) or bilateral cleft lip and palate (BCLP) consecutively treated with fixed appliances.
INTERVENTION: Fixed orthodontic appliance treatment and orthognathic surgery when required.
OUTCOMES: The PAR index assessment was carried out by a calibrated-independent assessor. Treatment duration, the number of patient visits, and data on dental anomalies were drawn from patient records and radiographs.
RESULTS: One hundred two patients' study models were assessed after exclusions. Mean start PAR score for UCLP (n = 71) was 43.9 (95% CI, 41.2-46.6, SD 11.5), with a mean score reduction of 84.3% (95% CI, 81.9-86.7, SD 10.1). The UCLP mean treatment time was 23.7 months with 20.1 appointments. Mean start PAR score for BCLP (n = 31) was 43.4 (95% CI, 39.2-47.6, SD 11.4), with a mean score reduction of 80.9% (95% CI, 76.3-85.5, SD 12.5). The BCLP mean treatment time was 27.8 months with 20.5 appointments.
CONCLUSION: These results compare well with other outcome reports, including those for patients without a cleft, and reflect the standard of care provided by an experienced cleft orthodontist. As with high-volume surgeons, orthodontic treatment for this high need group is favorable when provided by a high-volume orthodontist. These findings may be used for comparative audit with similar units providing cleft care.
METHODS: The norm-referenced method of standard setting was applied to the real scores of 40 final-year dental students on a multiple-choice question (MCQ), a short answer question (SAQ), and an objective structured clinical examination (OSCE). A panel of 10 judges set the standard using the modified-Angoff method for the same paper in one sitting. One judge set the passing score of 10 OSCE questions after 2 weeks. A comparison of the grades and pass/fail rates derived from the absolute standard, norm-referenced, and modified-Angoff methods was made. The intra-rater and inter-rater reliabilities of the modified-Angoff method were assessed.
RESULTS: The passing rate for the absolute standard was 100% (40/40), for the norm-referenced method it was 62.5% (25/40), and for the modified-Angoff method it was 80% (32/40). The modified-Angoff method had good inter-rater reliability of 0.876 and excellent test-retest reliability of 0.941.
CONCLUSION: There were significant differences in the outcomes of these three standard-setting methods, as shown by the difference in the proportion of candidates who passed and failed the assessment. The modified-Angoff method was found to have good reliability for use with a professional qualifying dental examination.