References
1. Madden LL, Rosen CA. Evaluation of Vocal Fold Motion Abnormalities: Are We All Seeing the Same Thing? J Voice. 2017;31(1):72-77.
2. Rosow DE, Sulica L. Laryngoscopy of vocal fold paralysis: evaluation of consistency of clinical findings. Laryngoscope.2010;120(7):1376-1382.
3. Estes C, Sadoughi B, Mauer E, Christos P, Sulica L. Laryngoscopic and stroboscopic signs in the diagnosis of vocal fold paresis.Laryngoscope. 2017;127(9):2100-2105.
4. Liu YC, McElwee T, Musso M, Rosenberg TL, Ongkasuwan J. The reliability of flexible nasolaryngoscopy in the identification of vocal fold movement impairment in young infants. Int J Pediatr Otorhinolaryngol. 2017;100:157-159.
5. Menon R PL, Soraghan JJ, Lakany H, MacKenzie K, Hilmi O, DiCaterina G. . Automatic quantification of vocal cord paralysis: An application of fibre-optic endoscopy video processing. . Paper presented at: 10th International Joint Conference on Biomedical Engineering Systems and Technologies.2017.
6. Gwent KL. Handbook of inter-rater reliability: The definitive guide to measuring the extent of agreement among raters (4th ed.). In: Gaithersburg M, ed.: Advanced Analytics; 2014.
7. Girard JM. Master Inter-Observer Reliability. 2019; http://mreliability.jmgirard.com.
8. Shoukri MM, Asyali, M.H. and Donner, A. Sample Size Requirements for the Design of Reliability Study: Review and Results. Statistical Methods in Medical Research. 2004;13:251-271.
9. Giraudeau B, Mary JY. Planning a reproducibility study: how many subjects and how many replicates per subject for an expected width of the 95 per cent confidence interval of the intraclass correlation coefficient. Stat Med. 2001;20(21):3205-3214.
10. Donner A, Eliasziw M. Sample size requirements for reliability studies. Stat Med. 1987;6(4):441-448.
11. Fleiss JL. Measuring Nominal Scale Agreement among Many Raters. .Psychological Bulletin. 1971;76:378-382.
12. Wu AP, Sulica L. Diagnosis of vocal fold paresis: current opinion and practice. Laryngoscope. 2015;125(4):904-908.
Table 1. Rating scale used by the consultants