Impact of statistical significance and sample size on conclusions in sports science research – an analysis on the example of the relative age effect

Authors: Ib K. Keune

1Department of Sport Science, Humboldt-Universität zu Berlin, Berlin, GER

Corresponding Author:

Ib K. Keune, M.Ed., PT
Philippstraße 13
10115 Berlin
ib.keune@hu-berlin.de
017681194891

Ib K. Keune is sport sociology doctoral student at the Humboldt-Universität zu Berlin. His areas of research interest include the relative age effect in sports and its interaction with factors of social inequality, statistics and methods in sport research, and applied ethics in sports.

Impact of statistical significance and sample size on conclusions in sports science research – an analysis on the example of the relative age effect

ABSTRACT

Purpose: The null hypothesis significance test (NHST) is a commonly applied statistical method for detecting effects in science, despite it being repeatedly criticized. Detractors argue that by focusing exclusively on NHST results, scientists fail to consider descriptive results, potentially leading to misinformed policy makers. They also point out that the influence of sample size on statistical power is often overlooked. This paper investigates whether this critique holds true in sport science research by analyzing the conclusions in publications about the relative age effect (RAE) – an effect manifested in biased birth date patterns. Method: In an extensive content analysis, 7,247 samples listed in 647 sources were recorded and analyzed using binary logistic regression. Results: Findings show discrepancies between NHST results and birth patterns. Authors in RAE research rely more heavily on NHST results than on birth patterns to draw their conclusions regarding the presence of a RAE. In addition, findings indicate that NHST results are influenced by sample size, birth pattern, and the interaction of both. This interaction leads to a RAE more often being suspected in large samples than small samples, even though birth patterns are more evenly distributed in large samples. Conclusion: As large samples are more likely to represent recreational sport and small samples are more likely to represent elite sport, the strong orientation towards NHST results for conclusions can lead to misinformation about the location of substantial RAEs. Applications in Sport: Similar reliance on NHST results and potential misinformation are also to be expected in other topics in sport research, where characteristics like elite status tend to accumulate in certain sample sizes. Decision-makers in sport should contextualize research findings. Researchers should use NHST appropriately and carefully and combine it with other statistical measures.Key Words: null hypothesis significance testing, birthdate effect, metascience

(more…)
2023-10-03T13:40:10-05:00October 6th, 2023|Research, Sports Management|Comments Off on Impact of statistical significance and sample size on conclusions in sports science research – an analysis on the example of the relative age effect

Which global tennis rating better measures player skill? Evidence from the 2022 USTA Junior National Championships

Authors: Rebecca L. Mayew1 and William J. Mayew2

1USPTA Tennis Coach, Cary, NC, USA
2Fuqua School of Business, Duke University, Durham, NC, USA

Corresponding Author:

William J. Mayew
Fuqua School of Business
Duke University
100 Fuqua Drive
Durham, NC 27708
919-660-7781
wmayew@duke.edu

Rebecca L. Mayew, MS is a tennis coach certified by the United States Professional Tennis Association (USPTA) with interests in player development and player performance measurement.

William J. Mayew, MS, PhD is a Professor of Business Administration at Duke University. His research focuses on performance measurement of financial analysts and public corporations as well as the prediction of financial reporting fraud.

Which global tennis rating better measures player skill?  Evidence from the 2022 USTA Junior National Championships

ABSTRACT

Assessing relative player skill is important in many aspects of tennis. In 2008, the Universal Tennis Rating (UTR) was introduced as a global tennis player skill rating that put all players, regardless of gender, age or geographic location, on a common scale.   The International Tennis Federation (ITF) recently launched a competitor rating called the World Tennis Number (WTN).  The purpose of this paper is to provide evidence on which rating is a superior measure of player skill.  We assume better skilled players are more likely to win tennis matches and examine whether UTR or WTN ratings better predict head-to-head match success using 1,532 matches played by 870 participants at the 2022 United States Tennis Association (USTA) Junior National Championships.  We observe classification accuracy of 73.9% and 70.4% for UTR and WTN ratings, respectively.  Both classification accuracy levels are statistically greater than chance and approximate the accuracy level observed for bookmakers at the professional level.  UTR and WTN rating classification accuracy does not statistically differ between ratings in the sample overall, by age division, by gender, by match format, or by the magnitude of player rating differences.  We conclude that UTR and WTN ratings are equivalent measures of player skill based upon their ability to predict match outcomes.  These findings provide initial empirical evidence important to tennis organizations making rating adoption decisions, tennis coaches seeking play parity, tournament directors seeding players and college coaches screening potential recruits.  We provide mapping functions between UTR and WTN ratings for situations where players have one rating but not the other.

Keywords:  Universal Tennis Rating (UTR), World Tennis Number (WTN), junior tennis, match forecasting, classification accuracy

(more…)
2023-09-14T16:02:49-05:00August 25th, 2023|Research, Sports Management|Comments Off on Which global tennis rating better measures player skill? Evidence from the 2022 USTA Junior National Championships

Return to Play and Learn: Findings from a Countywide High School Sports-Related Concussion Program

Authors: Gillian Hotz PhD1, Jacob R. Griffin2, Hengyi Ke3, Raymond Crittenden IV2, Abraham Chileuitt MD4

1Department of Neurosurgery, University of Miami Miller School of Medicine, Miami, FL, USA

2KiDZ Neuroscience Center, The Miami Project to Cure Paralysis, University of Miami Miller School of Medicine, Miami, FL, USA

3Department of Public Health, Division of Biostatistics, University of Miami Miller School of Medicine, Miami, FL, USA

4Department of Neurology, University of Miami Miller School of Medicine, Miami, FL, USA

Corresponding Author:

Gillian Hotz, Ph.D.
1095 NW 14th Ter
Miami, FL 33136
ghotz@med.miami.edu
305-243-2074

Gillian A. Hotz, PhD is a research professor at the University of Miami Miller School of Medicine and a nationally recognized behavioral neuroscientist and expert in pediatric and adult neurotrauma, concussion management, and neurorehabilitation. Dr. Hotz is the director of the KiDZ Neuroscience Center, WalkSafe, and BikeSafe programs.

Return to Play and Learn: Findings from a Countywide High School Sports-Related Concussion Program

ABSTRACT

Purpose
To report return to play (RTP) and learn (RTL) findings of high school athletes with a sports-related concussion (SRC) from a 10-year injury surveillance system. The goal was also to explore differences between athletes who received and did not receive academic accommodations.

Methods

SRC data was entered into a REDCap database by certified athletic trainers (ATs) at 35 public high schools in Miami-Dade County (MDC). A required 6 Steps to Safe Play concussion protocol was implemented between 2012 to 2022. Concussion Clinic data was also reported for as well as symptom scores of post-injury ImPACT retesting.

Results

From review and analysis of the ImPACT retesting scores, the most common symptoms reported included; headache (54.0%), difficulty concentrating (35.0%), sensitivity to light (34.6%), and dizziness (30.5%). Overall, female athletes reported a higher symptom count and severity on post-injury ImPACT assessments than males (7 vs. 4 total symptoms score; p < 0.001), and all but 4 of the 22 reportable symptoms listed on the symptom inventory (vomiting, fatigue, numbness/tingling, and difficulty remembering) were significant (p < 0.05) between males and females. Despite experiencing a greater number of overall SRCs, athletes playing football had a smaller average (p < 0.001) ImPACT total symptom score than athletes playing other sports (10.9 vs. 14.2). Those seen in clinic and receiving academic accommodations were less likely to RTP, have a greater (p < 0.05) ImPACT total symptom score, more days between injury date and post-ImPACT testing, and a greater number of days until returning to play than athletes not academically accommodated.

Conclusions

It is important for concussion providers to identify and monitor symptoms post-SRC. Study findings report that high school female athletes report more symptoms following an SRC and that appropriate academic accommodations should be included when necessary to ensure athletes recover in a safe and timely manner. Understanding how SRC symptoms vary based on an athlete’s circumstances can help in managing SRC and making better RTL and RTL decisions.

Application In Sports

Academic accommodations, when appropriate, should be incorporated and implemented in an athlete’s recovery plan to help them safely return to the field and classroom after an SRC.

Key Words: Concussion, Adolescent, Accommodations, Symptoms

(more…)
2023-08-25T14:38:06-05:00August 25th, 2023|Research, Sports Management|Comments Off on Return to Play and Learn: Findings from a Countywide High School Sports-Related Concussion Program

Marketing Division II athletics to college students: The perceived effectiveness of internally focused promotion tactics

Authors: Martin Barrett and Jeffrey R. Farr

Department of Recreation and Parks Management, Frostburg State University, Frostburg, MD, USA

Corresponding Author:

Martin Barrett, PhD
101 Braddock Road
Frostburg, MD 21532-2303
mbarrett@frostburg.edu
301-687-4475

Martin Barrett, PhD is an Assistant Professor of Sport Management at Frostburg State University in Frostburg, MD. His diverse research interests focus on sport and environmental sustainability, the diffusion of non-traditional sports, and divisional reclassification within intercollegiate athletics.


Jeffrey R. Farr, PhD is an Assistant Professor of Recreation, Parks, and Sport Management at Frostburg State University in Frostburg, MD. His research interests focus on understanding the relationships between families and youth sport participation.

Marketing Division II athletics to college students: The perceived effectiveness of internally focused promotion tactics

ABSTRACT

Sport-based incentives such as sales promotions and atmospheric efforts such as augmenting the core product with entertainment programming are widely used in sport to increase attendance at events. Despite this, there is little understanding regarding the effectiveness of marketing and promotion activities in persuading and motivating college students to attend Division II athletic events. Therefore, this paper sought to understand the
perceived effectiveness of different types of marketing and promotion activities, as well as the relationship between perceived effectiveness and existing attendance behavior. Surveys collected from students attending a public university in the Mid-Atlantic region (N=327) revealed that behavioral response incentives – marketing tactics where the sport product is augmented to better match the primary motive for fan attendance – have the greatest perceived effectiveness in persuading and motivating attendance. In addition, behavioral response incentives were positively related to attendance behavior; meaning students who were already regularly attendees perceived these types of marketing and promotion activities to be even more effective. The results from this study should guide athletic marketing efforts at the Division II level in the implementation of marketing and promotion activities to generate optimal return on investment.


Key Words: athletics, marketing, promotion, incentives, atmospherics

(more…)
2023-05-12T17:48:58-05:00May 12th, 2023|Research, Sports Management|Comments Off on Marketing Division II athletics to college students: The perceived effectiveness of internally focused promotion tactics

Age, regional distribution, and fighting styles of elite mixed martial arts athletes

Authors: Chenghao Ma

School of Humanities and Social Science, The Chinese University of Hong Kong, Shenzhen, China

Corresponding Author:

Chenghao Ma
2001 Longxiang Blvd.,
Shenzhen, China 518172
machenghao@cuhk.edu.cn

Chenghao Ma is now at the School of Humanities and Social Science, The Chinese University of Hong Kong, Shenzhen.

Age, regional distribution, and fighting styles of elite mixed martial arts athletes

ABSTRACT

This study aims to analyze the age, regional distribution, and fighting styles of 174 top-ranking Ultimate Fighting Championship (UFC) elite athletes to encourage the long-term success of coaches and athletes in terms of athletic development, talent selection, and training strategies. It uses frequency and descriptive statistical analysis to reveal age, nationality, and differences between fighting styles. A t-test was conducted to identify the age differences of male and female athletes within the same weight divisions, and a one-way ANOVA test was applied to see if there were significant differences between these weight divisions. Results showed that the athletes competed within a wide age range (23-42 years old), with a mean age of 31.82±3.77 years (male: 31.75±3.70; female: 32.00±3.99). There was no significant difference in the ages of male and female athletes or between weight classes, and most athletes were aged between 26 and 35 years, which accounted for 80% of the total number. Athletes represented 33 different countries, with more from the United States and Brazil (58.6%). They displayed 13 different fighting styles, categorized into styles in which either mixed, striking, or grappling were dominant, accounting for 44.9%, 32.7%, and 22.4%, respectively. The resultant data showed that UFC elite athletes compete with mixed fighting styles, with striking styles being more widespread, which is different when compared with the early stages of the event when grappling or wrestling styles were dominant in competition.

Key Words: combat sports; UFC; athletic performance; talent selection; training strategies

(more…)
2023-04-03T15:54:20-05:00April 7th, 2023|Research, Sports Management|Comments Off on Age, regional distribution, and fighting styles of elite mixed martial arts athletes
Go to Top