An investigation of inter-operator reliability tests for real-time analysis system

Hyongjun Choi, Peter O’Donoghue and Mike Hughes

International Journal of Performance Analysis in Sport, 2007, vol. 7, issue 1, 49-61

Abstract: Sports performance data has been measured and collected by a variety of methods including different measurement tools or systems in the field of performance analysis of sport. Lapse-time analysis (LTA) has often been used rather than real-time analysis (RTA) because of the difficulties of data gathering, presentation of the results, non-feasibility of feedback during match time and the selection of valid performance indicators (PIs). RTA data has often been used to enhance performances and, therefore, it is necessary to investigate the reliability tests used on such data.Pearson’s r, Chi-square, % error and Kappa tests statistics were used to evaluate the reliability between independent observers. A peer review process of modelling different levels of reliability with synthetic data demonstrated that kappa was the only one of the four statistics to have construct validity for the purpose of reliability assessment. With the Cybersport system for basketball, kappa values for the system as a whole of 0.8 or above are interpreted as good while values of 0.6 to 0.8 are acceptable. When using kappa for post hoc reliability analysis of individual event types, values of 0.5 or above can be considered as acceptable.

Date: 2007
References: View complete reference list from CitEc
Citations:

Downloads: (external link)
http://hdl.handle.net/10.1080/24748668.2007.11868387 (text/html)
Access to full text is restricted to subscribers.

Related works:
This item may be available elsewhere in EconPapers: Search for items with the same title.

Export reference: BibTeX RIS (EndNote, ProCite, RefMan) HTML/Text

Persistent link: https://EconPapers.repec.org/RePEc:taf:rpanxx:v:7:y:2007:i:1:p:49-61

Ordering information: This journal article can be ordered from
http://www.tandfonline.com/pricing/journal/RPAN20

DOI: 10.1080/24748668.2007.11868387

Access Statistics for this article

International Journal of Performance Analysis in Sport is currently edited by Peter O'Donoghue

More articles in International Journal of Performance Analysis in Sport from Taylor & Francis Journals
Bibliographic data for series maintained by Chris Longhurst ().