For the Good of the Game: What Keeps Soccer Referees from Renewing Their Licenses
Authors: Dr. J Ross Pruitt1, Dr. Dexter Davis2
Corresponding Author:
J. Ross Pruitt* Professor Department of Agriculture, Geosciences, and Natural Resources
269 Brehm Hall University of Tennessee at Martin
Martin, Tennessee 38238
Phone: (731)881-7254 Fax: (731)881-7968 rpruit10@utm.edu
For the Good of the Game: What Prevents Soccer Referees from Renewing Their Licenses
ABSTRACT
The United States faces a critical shortage of youth sports referees despite a growing interest in many sports. This issue is increasingly gaining attention from sanctioning bodies, referee associations, and researchers. There is a significant cost of referee turnover and implementing strategies implemented to increase retention of officials, especially in soccer. Correct identification of the issues resulting in non-renewal of referee licenses will increase the likelihood of retention strategies being successful. This study builds on existing research by using best-worst scaling to provide a preference share on the factors that result in non-renewal which Likert scales cannot provide. Current and former U.S. Soccer Federation referees in Tennessee were surveyed to determine which factors are most likely to motivate their decision to not renew their referee license. Findings from this research indicate that motivations are different from youth referees compared to adult referees. Youth referees find the cost of refereeing and assigning are resulting in non-renewal of licenses compared to lack of respect and changing work commitments among adult referees. Results of this research can be used to improve retention strategies across age groups.
Keywords: best-worst scaling, soccer referees, referee motivations, referee retention
Organized sports are an important part of society within the United States as it allows recreational and entertainment opportunities for participants and spectators. Sports officials are often referred to as the “third team” and are a critical aspect to the success of organized sports. In recent years, the popular press has been bombarded with stories of referee shortages (e.g., Conlon, 2022; Medina, 2022; Yurkevich, 2023) and physical attacks (Mendola, 2014; Ortiz, 2015; Weir, 2022; Hamacher, 2023). A majority of states have enacted or are considering laws to protect referees according to the National Association of Sports Officials (NASO) who tracks the status of legislation impacting sports officials (NASO, n.d.).
Even with increased awareness of the issues of referee shortages, verbal abuse and/or physical assaults, and growing legal protections, organized sports in the United States are still facing a shortage of officials. National and grassroots sport associations have enacted strategies to reduce the turnover to aid in recruitment (Titlebaum et al., 2009) and retention (Warner et al., 2013) of sports officials. These efforts will take time to minimize the impact of verbal abuse and physical assaults that are believed to result in the exodus of sports officials (Warner et al., 2013; Downward et al., 2023). Prior research has explored the factors that result in individuals deciding to become a sports official (Furst, 1991; Kellett and Warner, 2011; Johansen, 2015; Baldwin and Vallance, 2016) and continuing as a sports official (Rainey, 1999; Rainey and Hardy, 1999; Kellett and Shilbury, 2007; Kellett and Warner, 2011; Cuskelly and Hoye, 2013; Ridinger et al., 2017; Da Gama et al, 2018; Giel and Brewer, 2020; Orviz-Martinez et al, 2021; Downward et al., 2023), but the factors resulting in non-renewal of licenses needed to officiate is less clear in the literature.
The internal and external factors that draw individuals to officiate sports are important motivators to keep renewing their license. When one or more of these factors dissipate or change, an official’s lagging desire to continue can result in non-renewal of the soccer refereeing license. Licenses to officiate soccer are typically renewed annually which requires a conscious decision to continue or not continue. This provides the official with the opportunity to reflect whether the benefits of officiating (e.g., financial, health, social) continue to exceed the costs (e.g. cost to renew the license, additional time away from family, job stress, verbal abuse). As very few soccer referees can rely financially on officiating income alone, the need to balance family, career, and officiating is present. The popularity of youth soccer results in a constant cadre of referees needing recruitment, introductory and advanced training, and retention at the youth and grassroots level. Past research (e.g., Gomes et al, 2021) has used Likert scales and qualitative interviews to determine factors that impact continued refereeing of soccer. This study adds to the existing literature by inviting current and former soccer officials to make a choice among the alternative factors included on the survey instrument. The method used in this study presents a direct ranking of factors not provided in Likert scales. This paper continues with a literature review of the existing literature of factors attracting individuals to officiate sports and what results in the decision to no longer referee followed by a description of our survey methodology. Our survey population included current and former U.S. Soccer Federation referees. Results are then discussed with suggestions for future research presented.
Literature Review
The reasons an individual becomes a sports official are complex, but often include altruistic motivations (Balch and Scott, 2007) and love of the sport (Burke, Joyner, Pim, and Czech, 2000). Furst (1991) and Balch and Scott (2007) state that officials continue to officiate for social and interpersonal reasons along with a commitment to the sport. Kellett and Shilbury (2007) discuss the importance of the social and interpersonal support provided between officials to cope with the stress of officiating sports. The stress is, in part, a reflection of the need to quickly and correctly apply the rules of the sport while being in the proper position to make a decision. Initial training of new sports officials often focuses primarily on knowing the rules of the sport with some field training to practically apply what is learned. Factors that are important to keep beginning officials engaged in officiating such forming interpersonal relationships (e.g., Furst, 1991; Balch and Scott, 2007; Kellett and Shilbury, 2007; Kellett and Warner, 2011; Baldwin and Vallance, 2016) and coping with stress (e.g., Voight, 2009) are not the primary focus of initial trainings.
Officiating sports is a stressful experience due to the complexity of making quick decisions (Guillén and Jiménez, 2001; González-Oya, 2006; Gama et al., 2018) in an environment where positive feedback for correct decisions is limited. In younger and/or inexperienced officials, the lack of experience in these environments and ability to cope with the accompanying stress can contribute to referees no longer officiating (Cuskelly and Hoye, 2013). Prior research has focused on the connection between stressors and burnout (Rainey and Hardy, 1999; Voight, 2009; Da Gama et al., 2018; Gomes et al., 2021; Orviz-Martinez et al., 2021; Downward et al., 2023) with tools like the Burnout Inventory for Referees developed by Weinberg and Richardson (1990). Stressors experienced by sports officials are not always related to the sporting event but can be representative of other factors in their lives including work, family, and support of the organization for which they officiate (Voight, 2009; Cuskelly and Hoye, 2013).
Reasons that individuals begin refereeing may not always be the reasons they intend to continue. Kellett and Shilbury (2007) document that the interpersonal relationships developed can overcome nervousness experienced by beginning officials. These interpersonal relationships can be a positive stressor, or an indication of commitment described in Cuskelly and Hoye (2013). These may be social in nature can result in officials who, “are likely to feel somewhat compelled to continue officiating through various social mechanisms” (Cuskelly and Hoye, 2013). The level of organizational support, or the official’s perception of support, can result in an intention to continue officiating (Rainey, 1999; Kellett and Warner, 2011).
Giel and Breuer (2020) find the altruistic motives are not a significant factor in continuing to referee. This highlights the importance of the social relationships as the stress associated with officiating, balancing family, job, and officiating, the stress associated with maintaining the desired level of performance, or other factors can result in the official questioning their desire to continue. This contributes to the belief often expressed in the popular press that burnout and verbal abuse/physical assault are primary motivators to officials leaving the sport (Kellett and Shilbury, 2007). The ability to reframe the abuse as described in Kellett and Shilbury (2007) may limit the extent to which the perception is reality. Voight (2009) finds the conflict between family and officiating, making a controversial call, conflict between work and officiating, making the wrong call, and verbal abuse from coaches as the top stressors among college soccer officials. The least amount of stress can be attributed to the fear of physical harm (Voight, 2009).
Methods
The decision to not renew one’s soccer referee license reflects the costs of continuing to referee (whether financial, social, or emotional) relative to the benefits accrued by refereeing. We hypothesize that referees will consider not renewing their license prior to the actual decision where the license is not renewed (Rainey and Hardy, 1999; Cuskelly and Hoye, 2013). Factors that motivate the decision to not renew one’s license are presented in Table 1. Included factors represent those included in the literature (e.g., Furst, 1991; Rainey, 1999; Rainey and Hardy, 1999; Burke et al., 2000; Balch and Scott, 2007; Kellett and Shilbury, 2007; Cuskelly and Hoye, 2013; Johansen, 2014; Giel and Breuer, 2020) as well as those from our personal experiences refereeing and coaching soccer. After the factors shown in Table 1 were selected to include in the questionnaire, the staff and mentors of the U.S. Youth Soccer Region III Championships reviewed our factors and accompanying descriptions for thoroughness. Their suggestions are reflected in our final factors presented in Table 1.
Use of best-worst scaling (Finn and Louviere, 1992) provides the relative importance that a factor can have on a referee’s continued interest in renewing their license. This method provides an improvement over qualitative interviews which can provide insight into motivations for referees, but not a hierarchical preference ranking that can be used by referee associations to assist in retention of referees. An additional benefit of best-worst scaling is the fact it provides a ratio scale for its results unlike a Likert rating scale that may result in the ordinal ranking not being consistent across respondents (Steenkamp and Baumgartner, 1998; Lusk and Briggeman, 2009). This provides greater insight into the obstacles for a referee to annually renew their license which can lead to increased retention efforts and educational efforts by clubs and sanctioning bodies to reduce the impact of factors resulting in non-renewal of licenses.
Best-worst scaling provides the respondent the ability to select the factor that provides the most and least utility in a choice set which Likert scales do not provide. This approach has significant implications for marketing (Cohen, 2009; O’Reilly and Huybers, 2015; Massey, Wang, and Waller, 2015) to help identify specific factors that consumers find desirable. Use of this method has extended into the healthcare industry (Flynn et al., 2007) and the value of public information (Pruitt et al., 2014). Given J factors, there are J(J-1) combinations a respondent could select for each best-worst question. The choice of the most important factor j by individual i can by represented by λj on the utility scale with the latent level of utility determined by Iij = λj + εij which assumes that εij is the random error term. By selecting factor j as the most important factor and factor k as the least important is determined by the probability for all other J(J-1)-1 possible differences in the choice set.
Results from best-worst scaling normally occurs through a multinomial or random parameters logit. Estimate coefficients have little interpretation aside from the magnitude of the coefficient. Preference shares for each factor’s impact on lack of interest in continuing to referee is calculated using the following equation preference share for factor.
Respondents were asked if they had actively considered not renewing their U.S. Soccer Federation (USSF) referee license in the past five years. Individuals that responded yes, were then asked best-worst questions using the factors that were identified and presented in Table 1. Using PROC OPTEX in SAS 9.4, a quasi-balanced incomplete block design (BIBD) was created. The design had a treatment D-efficiency of 90.78 and a block design D-efficiency of 99.86. This resulted in twelve best-worst questions with six factors present in each question. Each factor appeared six times to each respondent with an example of the best-worst questions is provided in Figure 1.
Figure 1. Example Best-Worst Question
Survey
A web-based Qualtrics survey was created that was distributed to current and former U.S. Soccer Federation referees implementing the best-worst questions discussed previously. Through contacts with the Tennessee Soccer Referee Program, we were able to distribute the questionnaire to 3,507 current and former referees. Our ability to contact referees who had not recertified in the previous four years is due to the Tennessee Soccer Referee Program adopting computer software that allows the program to track referees who do not re-certify from year to year. Inclusion of youth referees (between the ages of thirteen and eighteen) was approved by our university’s Institutional Review Board which allows for determination if factors vary by age. Per USSF policy, any email contact from a certified USSF assignor results in the parent/guardian also being contacted1. This resulted in parents/guardians of current and former youth referees also receiving the recruitment email. Initial questions identified if the respondent was at least eighteen years of age and then determined if the respondent was answering for themselves or as parent/guardian of a current or former youth soccer referee2. For youth referees, we included questions that determined if their parent/guardian had provided consent in addition to the minor providing assent. As the parent/guardian also received the recruitment email, email addresses for minors were collected in case the parent/guardian revoked consent necessitating removal of youth referee responses. No parent or guardian contacted us requesting removal of the youth referee’s responses.
A recruitment email was sent in early March 2023 to 3,507 current and former referees registered with USSF in the state of Tennessee with a follow-up email sent two weeks later. An incentive was offered to each respondent of a gift card worth $100 to a referee equipment supplier or a free registration for the 2023 year. Email addresses were collected at the end of the questionnaire and provided to the Tennessee Soccer Referee Program which was responsible in selecting and contacting the winners of the inducement. We received 107 usable responses for a response rate of 3.05%.
Results Demographic information is provided in Table 2. Total responses did vary by question as respondents were not required to answer every demographic question which were asked following the best-worst questions. Respondents were overwhelmingly male and Caucasian. Approximately forty percent of respondents were less than twenty-five years of age and an additional twenty-five percent between the ages of forty-three and fifty-four. Over sixty percent who responded were no longer refereeing soccer with approximately two-thirds believing they were assigned the appropriate number of matches given their skill and ability level. Those receiving the questionnaire were asked an open-ended question on how many years they refereed soccer. Of the 110 responses, many did not provide an exact number. For those who provided an exact number, the average number of years that survey participants had refereed was 8.63 years. Given responses not included in this calculation that stated they had refereed 10+, 20+, or 50+ years, this estimate of 8.63 understates the longevity of referees in this research. A histogram of responses for this question is presented in Figure 2. More than three-quarters of respondents refereed no more than sixty matches a year with the majority refereeing less than fifteen matches annually. Over ninety percent of respondents only refereed soccer. Nearly seventy percent of respondents had suffered verbal abuse in the past two years with approximately five percent having suffered a physical assault (e.g., touched, pushed, shoved, punched, kicked, or spat on) by a player, coach, fan, or parent. Parents and coaches were most likely to have been the source of verbal abuse with players being the source of physical assault.
As we were able to include youth referees (less than eighteen years old), we conducted t-tests for significant differences in means between those who had actively considered not renewing their USSF licenses for youth and adult referees. We did not test for differences in means in age and educational attainment categories since we compared those less than eighteen of ages to all other ages in this comparison. Differences in the mean at the 5% level of significance (p<0.05) were found in these groupings with less than fifteen matches officiated, whether the respondent felt they were under assigned, assigned the right number of matches for their skill/ability level, and whether they play organized soccer. Table 2 includes these results.
Table 2. Demographic Information
Variable | Mean | Standard Deviation |
Gender (n=111) | ||
Male | 75.68% | 0.43 |
Female | 23.42% | 0.43 |
Prefer Not to Say | 0.90% | 0.09 |
Ethnicity (n=111) | ||
Caucasian | 76.58% | 0.43 |
African American | 0.00% | 0.00 |
Hispanic | 5.41% | 0.23 |
Native American | 0.00% | 0.00 |
Asian | 0.00% | 0.00 |
Multi-racial | 6.31% | 0.24 |
Other | 2.70% | 0.16 |
Prefer Not to Say | 5.41% | 0.23 |
Age (n=111) | ||
13-17 | 22.52% | 0.42 |
18-24 | 21.62% | 0.41 |
25-30 | 8.11% | 0.27 |
31-36 | 6.31% | 0.24 |
37-42 | 1.80% | 0.13 |
43-48 | 11.71% | 0.32 |
49-54 | 13.51% | 0.34 |
55-60 | 3.60% | 0.19 |
Over 60 | 10.81% | 0.31 |
Education Level (n=111) | ||
Currently in Middle/High School | 27.03% | 0.45 |
High School Diploma or GED | 0.00% | 0.00 |
Trade, vocational, or technical school | 4.50% | 0.21 |
Associate Degree | 4.50% | 0.21 |
Bachelor’s Degree | 27.93% | 0.45 |
Master’s Degree | 15.32% | 0.36 |
Doctoral or Professional Degree | 7.21% | 0.26 |
Prefer Not to Say | 1.80% | 0.13 |
Household Income (n=110) | ||
Less than $40,000 | 10.00% | 0.30 |
$40,000 to $60,000 | 9.09% | 0.29 |
$60,001 to $80,000 | 8.18% | 0.28 |
$80,001 to $100,000 | 5.45% | 0.23 |
Greater than $100,000 | 40.00% | 0.49 |
Prefer Not to Say | 27.27% | 0.45 |
Table 2. Continued
Variable | Mean | Standard Deviation |
Residence (n=111) | ||
Urban Area | 14.41% | 0.35 |
Suburban Area | 66.67% | 0.39 |
Rural Area | 18.92% | 0.47 |
Levels Officiated1 | ||
Youth recreational | 33.46% | |
Club | 28.31% | |
AYSO | 7.35% | |
High School | 16.18% | |
College | 3.68% | |
Adult Amateur/Recreational | 10.29% | |
Professional | 0.74% | |
Approximate number of annual matches | ||
Less than 15 | 30.91%2 | 0.46 |
16-30 | 19.09% | 0.39 |
31-45 | 13.64% | 0.34 |
46-60 | 12.73% | 0.33 |
61-75 | 5.45% | 0.23 |
76-90 | 8.18% | 0.28 |
91-105 | 2.73% | 0.16 |
Over 105 | 7.27% | 0.26 |
Proper Assigning Level (n=109) | ||
Under assigned | 25.69%2 | 0.44 |
Over assigned | 7.34% | 0.26 |
Right number | 66.97%2 | 0.47 |
Sports Officiated besides Soccer | ||
None | 92.73% | 0.26 |
1-2 | 6.36% | 0.25 |
3-4 | 0.91% | 0.10 |
5 or more | 0.00% | 0.00 |
Play Organized Soccer (n=110) | 43.64%2 | 0.50 |
Verbally Abused in Last Two Years (n=109) | 68.81% | 0.47 |
Source of Verbal Abuse1 | ||
Player | 18.96% | |
Coach | 27.01% | |
Fan | 22.27% | |
Parent | 31.75% |
Table 2. Continued
Variable | Mean | Standard Deviation |
Physically Assaulted in Last Two Years (n=109) | 4.59% | 0.21 |
Source of Physical Assault1 | ||
Player | ||
Coach | ||
Fan | ||
Parent | ||
Injury of at Least Four Weeks (n=109) | 11.93% | 0.33 |
Attend Continuing Education (n=110) | ||
Once a year | 28.18% | 0.45 |
Twice a year | 7.27% | 0.26 |
Three to four times a year | 10.00% | 0.30 |
At least five times a year | 0.00% | 0.00 |
Does not attend | 47.27% | 0.50 |
Accepts unsanctioned matches (n=110) | 12.73% | 0.33 |
Anticipates refereeing soccer: (n=110) | ||
No longer refereeing | 60.91% | 0.49 |
Less than one year | 7.27% | 0.26 |
One to two years | 12.73% | 0.33 |
Three to four years | 8.18% | 0.28 |
At least five years | 10.91% | 0.31 |
1 Question allowed multiple responses and standard deviations are not presented as a result.
2 Denotes significant differences at the 5% level (p<0.05) between youth and adult referees who had actively considered not renewing their license.
Non-Renewal of Referee License
Respondents who answered they had actively considered not renewing their license in the past five years were shown a series of questions asking them to select the most and least important factors impacting why they would not renew their refereeing license. As our sample included youth referees (those less than 18 years of age), we estimated a combined model for all referees responding against the alternative models of youth and adult referees. Each of these models was estimated using a multinomial logit (MNL), an uncorrelated random parameters logit (RPL), and a correlated random parameters logit model. Significant differences were found to exist between youth and adult referees who were considering not renewing resulting in separate models being estimates for youth and adult referees. Likelihood ratio tests favored the use of MNL model for both youth and adult referees.
Youth Referees
Results for youth referees are presented in Table 3 uses Work as the base factor with results. Estimates for the MNL and RPL models are presented with the MNL preferred by use of a likelihood ratio test. Aside from their magnitude, the econometric estimates in Table 3 have no natural interpretation and equation 1 was used to calculate the shares of preference that are presented. The shares of preference for the uncorrelated RPL model were generated from 1,000 random draws using a normal distribution of the mean and standard deviation of a specific factor that might result in a referee not renewing their USSF license. Shares of preference were consistent between the two modeling techniques as there was not greater than ±0.01% difference for any factor. The cost to referee (i.e., Afford) was the number one reason that youth referees had considered not renewing their USSF license. This factor includes the inability to make it to matches for youth referees reflecting the need for an adult or friend to help them make it to assignments. Note that even with a small sample size of youth referees, fifteen of the eighteen youth referees were no longer refereeing. The youth referee’s opinion on how well they were assigned was the second most important factor with the lack of Respect from fans, players, and coaches third (depending on the model used). It should be noted that the fourth most important factor was Game Fees, indicating the cost to benefit ratio for youth referees is contributing to non-renewals. The use of best-worst scaling provides a clearer view of the magnitude of factors resulting in youth referees not renewing their licenses through the direct comparisons with the lack of Respect relatively not as important as other factors.
Table 3. Relative Importance of Factor Impacting Non-Renewal of Youth Referee Licenses
Factor | Econometric Estimates | Shares of Preference | ||
MNL | RPL | MNL | RPL | |
Respect | 0.995*** | 1.000*** | 0.153 | 0.153 |
(0.255)a | (0.256) | [0.000] | [0.002] | |
[0.000]b | [0.018] | |||
Youth Involvement | -0.761*** | -0.763*** | 0.027 | 0.026 |
(0.252) | (0.254) | [0.000] | [0.000] | |
[0.000] | [0.000] | |||
Social Aspects | 0.271*** | 0.270 | 0.074 | 0.074 |
(0.258) | (0.265) | [0.000] | [0.002] | |
[0.000] | [0.172] | |||
Family Commitments | -0.865*** | -0.859*** | 0.024 | 0.024 |
(0.243) | (0.246) | [0.000] | [0.000] | |
[0.000] | [0.001] | |||
Injury | -0.491* | -0.496* | 0.035 | 0.034 |
(0.256) | (0.258) | [0.000] | [0.001] | |
[0.000] | [0.000] | |||
Lack of Opportunities to Advance | -0.189 | -0.188 | 0.047 | 0.047 |
(0.255) | (0.257) | [0.000] | [0.001] | |
[0.000] | [0.002] | |||
Cost to Referee | 1.123**** | 1.130*** | 0.174 | 0.174 |
(0.255) | (0.256) | [0.000] | [0.002] | |
[0.000] | [0.005] | |||
Age | -1.178*** | -1.138*** | 0.017 | 0.018 |
(0.248) | (0.279) | [0.000] | [0.001] | |
[0.000] | [0.355] | |||
Assigning | 0.999*** | 1.009*** | 0.154 | 0.155 |
(0.255) | (0.258) | [0.000] | [0.002] | |
[0.000] | [0.031] | |||
Game Fees | 0.913*** | 0.915*** | 0.141 | 0.141 |
(0.265) | (0.267) | [0.000] | [0.003] | |
[0.000] | [0.001] | |||
Lack of Organizational Support | 0.524** | 0.529** | 0.096 | 0.096 |
(0.258) | (0.259) | [0.000] | [0.001] | |
[0.000] | [0.001] | |||
Work | 0.000 | 0.000 | 0.057 | 0.058 |
(Base Factor) | [0.000] | [0.015] | ||
Log Likelihood | -625.138 | -624.910 | ||
McFadden’s LRI | 0.094 | 0.149 | ||
Number of Respondents | 18 | 18 |
***, **, and * asterisks represent the factor is significantly different from the Work factor at the 1%, 5%, and 10% level, respectively.
a Numbers in parentheses are standard errors.
b numbers in brackets are standard deviations.
In addition to the shares of preference presented in Table 3, we generated Pearson correlations from the individual specific RPL estimates shown in Table 4. Several factors had correlations with at least ±0.3 with another factor. Given the limited number of responses, care should be taken when viewing Table 4, but it provides an indication of how youth referees view these factors influencing their decision to not continue refereeing. The more likely a youth referee viewed the lack of Social camaraderie, the higher an injury might factor into a non-renewal decision. Importantly, the lack of Social connections had a strong direct relationship with their views of Organizational Support provided to them. Concerns about how many games the referee was assigned had a positive relationship with Game Fees being an important factor in the decision to not renew the license. Game Fees tended to have large (positive or negative) correlations with many factors that were included in this research.
Table 4. Pearson Correlations Between Factors from Individual Specific RPL Estimates of Youth Referees
Factor | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 |
Respect (1) | 1.000 | ||||||||||
Youth Involvement (2) | 0.007 | 1.000 | |||||||||
Assign (3) | -0.140 | 0.177 | 1.000 | ||||||||
Social (4) | -0.176 | 0.410 | -0.301 | 1.000 | |||||||
Injury (5) | -0.007 | -0.439 | -0.494 | 0.505 | 1.000 | ||||||
Advance (6) | -0.211 | -0.832 | 0.018 | 0.222 | 0.212 | 1.000 | |||||
Age (7) | 0.164 | 0.874 | 0.100 | -0.248 | -0.448 | -0.919 | 1.000 | ||||
Cost (8) | -0.043 | -0.159 | -0.264 | 0.227 | 0.079 | -0.073 | 0.096 | 1.000 | |||
Game Fees (9) | -0.123 | 0.725 | 0.476 | -0.569 | -0.737 | -0.538 | 0.694 | -0.046 | 1.000 | ||
Organizational Support (10) | 0.097 | -0.338 | -0.172 | 0.514 | 0.544 | 0.189 | -0.332 | 0.249 | -0.669 | 1.000 | |
Family (11) | -0.326 | -0.753 | -0.030 | 0.489 | 0.564 | 0.723 | -0.860 | -0.025 | -0.610 | 0.531 | 1.000 |
Adult Referees
Results for adult referees who had considered not renewing their USSF license are presented in Table 5. As with youth referees, a MNL model was preferred to an uncorrelated RPL model with the estimates from both models presented. Unlike youth referees, the lack of Respect experienced by adult referees is the primary reasons resulting in the non-renewal decision. Work commitments or a change in them was the second most important factor. Nearly two-thirds of adult referees who had considered not renewing their license were no longer refereeing; fifteen were considering not renewing in more than the next two years with only four considering refereeing at least four more years.
Table 5. Relative Importance of Factor Impacting Non-Renewal of Adult Referee Licenses
Factor | Econometric Estimates | Shares of Preference | ||
MNL | RPL | MNL | RPL | |
Respect | 0.558*** | 0.568*** | 0.237 | 0.238 |
(0.113) | (0.114) | [0.000] | [0.003] | |
[0.000] | [0.028] | |||
Youth Involvement | -1.571*** | -1.582*** | 0.028 | 0.028 |
(0.117) | (0.119) | [0.000] | [0.000] | |
[0.000] | [0.004] | |||
Social Aspects | -1.313*** | -1.312*** | 0.036 | 0.036 |
(0.118) | (0.131) | [0.000] | [0.001] | |
[0.000] | [0.3480] | |||
Family Commitments | -0.688*** | -0.688*** | 0.068 | 0.068 |
(0.112) | (0.131) | [0.000] | [0.002] | |
[0.000] | [.450] | |||
Injury | -0.794*** | -0.795*** | 0.061 | 0.061 |
(0.117) | (0.118) | [0.000] | [0.001] | |
[0.000] | [0.010] | |||
Lack of Opportunities to Advance | -0.828*** | -.833*** | 0.059 | 0.059 |
(0.116) | (0.117) | [0.000] | [0.001] | |
[0.000] | [0.001] | |||
Cost to Referee | -.481*** | -0.474*** | 0.084 | 0.084 |
(0.115) | (0.116) | [0.000] | [0.001] | |
[0.000] | [0.016] | |||
Age | -1.455*** | -1.468*** | 0.032 | 0.031 |
(0.117) | (0.127) | [0.000] | [0.001] | |
[0.000] | [0.179] | |||
Assigning | -0.491*** | -0.482*** | 0.083 | 0.083 |
(0.116) | (0.117) | [0.000] | [0.001] | |
[0.000] | [0.001] | |||
Game Fees | -0.350*** | -0.348*** | 0.095 | 0.095 |
(0.120) | (0.121) | [0.000] | [0.002] | |
[0.000] | [0.009] | |||
Lack of Organizational Support | -0.510*** | -0.514*** | 0.081 | 0.081 |
(0.115) | (0.116) | [0.000] | [0.001] | |
[0.000] | [0.001] | |||
Work | 0.000 | 0.000 | 0.135 | 0.135 |
(Base Factor) | [0.000] | [0.014] | ||
Log Likelihood | -2843.485 | -2838.531 | ||
McFadden’s LRI | 0.066 | 0.097 | ||
Number of Respondents | 77 | 77 |
***, **, and * asterisks represent the factor is significantly different from the Work factor at the 1%, 5%, and 10% level, respectively.
a Numbers in parentheses are standard errors.
b numbers in brackets are standard deviations.
As with the youth referees, Pearson correlations for the adult referees are presented in Table 6. A greater response rate among adults compared to youth referees provides more robustness in the correlations that are presented. It is interesting to note the strong negative correlation between Game Fees and Assign (-0.591) suggesting concerns about pay is not tied to assigning. Concerns about Game Fees and the ability to Advance had a strong positive relationship (0.607) indicating adult referees view the pay for higher level games isn’t a strong enough incentive to advance. Those referees who rated the inability to Advance highly was negatively correlated (-0.611) with concerns about being over or under assigned (Assign).
Table 6. Pearson Correlations Between Factors from Individual Specific RPL Estimates of Adult Referees
Factor | 1 | 2 | 3 | 4 | 5 | 6 | 7 | 8 | 9 | 10 | 11 |
Respect (1) | 1.000 | ||||||||||
Youth Involvement (2) | 0.063 | 1.000 | |||||||||
Assign (3) | -0.304 | -0.578 | 1.000 | ||||||||
Social (4) | -0.105 | -0.052 | 0.017 | 1.000 | |||||||
Injury (5) | 0.153 | 0.533 | -0.587 | -0.124 | 1.000 | ||||||
Advance (6) | 0.300 | 0.387 | -0.611 | 0.217 | 0.418 | 1.000 | |||||
Age (7) | -0.172 | -0.230 | 0.089 | -0.192 | -0.115 | -0.287 | 1.000 | ||||
Cost (8) | 0.275 | 0.179 | -0.460 | 0.028 | 0.196 | 0.542 | -0.282 | 1.000 | |||
Game Fees (9) | 0.046 | 0.444 | -0.591 | -0.124 | 0.401 | 0.607 | -0.015 | 0.336 | 1.000 | ||
Organizational Support (10) | 0.129 | -0.036 | -0.055 | -0.069 | 0.049 | -0.334 | -0.093 | 0.007 | -0.197 | 1.000 | |
Family (11) | -0.255 | -0.279 | 0.574 | -0.136 | -0.543 | -0.338 | 0.147 | -0.483 | -0.323 | 0.036 | 1.000 |
Conclusions
Concerns about retaining sports officials are a pressing factor for many sports with referee abuse a concern among leagues and official associations. Factors influencing the decision to not renew referee licenses are not well understood in the literature. Prior research has focused on qualitative factors impacting the renewal decision which doesn’t quantitatively rank factors included in the research. This research surveyed current and former referees who had actively considered not renewing their referee license with a majority no longer refereeing soccer. There were significant differences between youth and adult referees in the factors that had led them to consider not renewing their referee license. For youth, the cost to referee and concerns about being over- or under-assigned were the top two reasons for considering not renewing their license compared to adults who were more concerned about the lack of respect and work commitments. For both age groups, concerns about organizational support were significant factors as it relates to continuing refereeing.
Our study is limited by the small sample size, but it is an important look into the factors that resulted in a majority of referees no longer renewing their U.S. Soccer Federation license. While we do not focus on the well-being of referees as in Downward and Webb (2023), our findings are consistent with theirs that a zero-tolerance approach will aid in adult referee retention. This reinforces the need for organizational support (Rainey, 1995; Voight, 2007; Ridinger et al., 2017; Downward and Webb, 2023), but also requires training by those organizations on what to include in post-match reports to have the backing. As over 75% of respondents in our survey did not attend more than one continuing education session annually, sanctioning bodies and referee associations need innovative ideas to aid in reaching this objective.
Future research should focus on expanding this to referees who have not recently considered non-renewal of their referee licenses. This portion of the referee community will likely have different factors motivating their continued renewals as was demonstrated by the differences observed in this paper based on the age of the referee. Identification of the factors that aid in retention of these referees may aid in development of strategies to limit the impact of factors discussed in this research. Given the nature of soccer in the U.S., future research should better control for the differences in length of refereeing and level officiated (e.g., recreational versus club). With the number of young referees who work matches in the U.S., the skills necessary to be successful may not have been developed to handle the stressors commonly associated with officiating (Rainey, 1995; Rainey and Hardy, 1999; Burke et al., 2000; Voight, 2009; Gomes et al., 2021). A more diverse respondent pool, in terms of locality, gender, and ethnicity, is also needed to better understand why referees continue to engage in a stressful avocation.
Acknowledgements
The authors express appreciation to Don Eubank, State Referee Administrator for Tennessee Soccer, for sending the questionnaire to soccer referees in the state and providing the incentive for respondents to complete the questionnaire. We also thank the staff and mentors of U.S. Youth Soccer Region III for helpful feedback on an early draft of the questionnaire. The authors are grateful for the helpful edits and suggestions from Marco Palma on an earlier draft of this paper.
Conflicts of Interest
J. Ross Pruitt is an active soccer referee with the U.S. Soccer Federation, Tennessee Secondary School Athletic Association, and National Intercollegiate Soccer Official Association.
References
- Balch, M. J., & Scott, D. (2007). Contrary to Popular Belief, Refs are People Too! Personality and Perceptions of Officials. Journal of Sport Behavior, 30(1).Baldwin, Christopher, and Roger Vallance. “Rugby Union Referees’ Experiences with Recruitment and Retention,” n.d.
- Burke, K. L., Joyner, A. B., Pim, A., & Czech, D. R. (2000). An exploratory investigation of the perceptions of anxiety among basketball officials before, during, and after the contest. Journal of Sport Behavior, 23(1).Cohen, E. (2009). Applying best-worst scaling to wine marketing. International Journal of Wine Business Research, 21(1), 8-23. https://doi.org/10.1108/17511060910948008.
- Conlon, C. (2022, September 13). Years-long Montana referee shortage getting worse as cancellations loom. Q2 News (KTVQ). https://www.ktvq.com/news/local-news/years-long-referee-shortage-getting-worse-as-cancellations-loom. Accessed June 13, 2023.
- Cuskelly, G., & Hoye, R. (2013). Sports officials’ intention to continue. Sport Management Review, 16(4), 451-464.
- Da Gama, D. R. N., Nunes, R. D. A. M., Guimarães, G. L., Leandro De Lima, E. S., De Castro, J. B. P., & Vale, R. G. D. S. (2018). Analysis of the burnout levels of soccer referees working at amateur and professional leagues of Rio de Janeiro, Brazil. Journal of Physical Education and Sport, 18, 1168-1174.
- Downward, P., Webb, T., & Dawson, P. (2023). Referee abuse, intention to quit, and well-being. Research quarterly for exercise and sport, 1-11.
- Finn, A., & Louviere, J. J. (1992). Determining the appropriate response to evidence of public concern: the case of food safety. Journal of Public Policy & Marketing, 11(2), 12-25.
- Flynn, T. N., Louviere, J. J., Peters, T. J., & Coast, J. (2007). Best–worst scaling: what it can do for health care research and how to do it. Journal of health economics, 26(1), 171-189.
- Furst, D. M. (1991). Career contingencies: Patterns of initial entry and continuity in collegiate sports officiating. Journal of Sport Behavior, 14(2), 93.
- Giel, T., & Breuer, C. (2020). The determinants of the intention to continue voluntary football refereeing. Sport Management Review, 23(2), 242-255.
- Gomes, A. R., Fontes, L. M. C., Rodrigues, M., & Dias, B. (2021). Burnout in referees: Relations with stress, cognitive appraisal, and emotions. González-Oya, J. Psicología Aplicada al Árbitro de Fútbol: Características Psicológicas y su Entrenamiento; Wanceulen: Sevilla, Spain, 2006.
- Guillén, F., & Feltz, D. L. (2011). A conceptual model of referee efficacy. Frontiers in psychology, 2, 25.
- Guillén García, F., & Jiménez Betancort, H. (2001). Características deseables en el arbitraje y el juicio deportivo. Revista de psicología del Deporte.
- Hamacher, B. (2023, January 25). Soccer player arrested after video shows him attacking referee in Kendall: Police. NBC 6 South Florida. https://www.nbcmiami.com/news/local/soccer-player-arrested-in-kendall-referee-attack-caught-on-camera-police/2957549/. Accessed June 13, 2023.
- Jacobs, B. L., Tingle, J. K., Oja, B. D., & Smith, M. A. (2020). Exploring referee abuse through the lens of the collegiate rugby coach. Sport Management Review, 23(1), 39-51.
- Johansen, B. T. (2015). Reasons for officiating soccer: the role of passion-based motivations among Norwegian elite and non-elite referees. Movement & Sport Sciences-Science & Motricité, (87), 23-30.
- Kellett, P., & Shilbury, D. (2007). Umpire participation: Is abuse really the issue?. Sport Management Review, 10(3), 209-229.
- Kellett, P., & Warner, S. (2011). Creating communities that lead to retention: The social worlds and communities of umpires. European Sport Management Quarterly, 11(5), 471-494.
- Lusk, J. L., & Briggeman, B. C. (2009). Food values. American journal of agricultural economics, 91(1), 184-196.
- Massey, G. R., Wang, P. Z., Waller, D. S., & Lanasier, E. V. (2015). Best–worst scaling: A new method for advertisement evaluation. Journal of Marketing Communications, 21(6), 425-449.
- Medina, E. (2022, April 21). Bad behavior drove a referee shortage. Covid made it worse. The New York Times. https://www.nytimes.com/2022/04/21/sports/referee-shortage-youth-sports.html. Accessed June 13, 2023.
- Mendola, N. (2014, July 31). Testimony in death of Michigan referee provides disturbing glimpse into incident – NBC Sports. NBC Sports. https://soccer.nbcsports.com/2014/07/31/testimony-in-death-of-michigan-referee-provides-disturbing-glimpse-into-incident/. Accessed June 13, 2023.
- Legislation status – National Association of Sports Officials. (2023, October 12). National Association of Sports Officials. https://www.naso.org/resources/legislation/legislation-status/. Accessed November 1, 2023.
- O’Reilly, N., & Huybers, T. (2015). Servicing in sponsorship: A best-worst scaling empirical analysis. Journal of sport management, 29(2), 155-169.
- Referee drilled by two Texas high school football players was a Fill-In. (2015, September 9). NBC News. https://www.nbcnews.com/news/us-news/referee-pummeled-two-texas-high-school-football-players-was-fill-n424346. Accessed June 13, 2023.
- Orviz-Martínez, N., Botey-Fullat, M., & Arce-García, S. (2021). Analysis of burnout and psychosocial factors in grassroot football referees. International Journal of Environmental Research and Public Health, 18(3), 1111.
- Pruitt, J. R., Tonsor, G. T., Brooks, K. R., & Johnson, R. J. (2014). End user preferences for USDA market information. Food Policy, 47, 24-33.
- Rainey, D. (1995). Sources of stress among baseball and softball umpires. Journal of Applied Sport Psychology, 7(1), 1-10.
- Rainey, D. W. (1999). Sources of stress, burnout, and intention to terminate among basketball referees. Journal of sport behavior, 22(4), 578-590.
- Rainey, D. W., & Cherilla, K. (1993). Conflict with baseball umpires: An observational study. Journal of Sport Behavior, 16(1), 49-60.
- Rainey, D. W., & Hardy, L. (1999). Sources of stress, burnout and intention to terminate among rugby union referees. Journal of Sports Sciences, 17(10), 797-806.
- Ridinger, L. L., Warner, S., Tingle, J. K., & Kim, K. R. (2017). Why referees stay in the game. Global Sport Business Journal, 5(3), 22.
- Steenkamp, J. B. E., & Baumgartner, H. (1998). Assessing measurement invariance in cross-national consumer research. Journal of consumer research, 25(1), 78-90.
- Titlebaum, P. J., Haberlin, N., & Titlebaum, G. (2009). Recruitment and retention of sports officials. Recreational Sports Journal, 33(2), 102-108.
- Voight, M. (2009). Sources of stress and coping strategies of US soccer officials. Stress and Health: Journal of the International Society for the Investigation of Stress, 25(1), 91-101.
- Warner, S., Tingle, J. K., & Kellett, P. (2013). Officiating attrition: The experiences of former referees via a sport development lens. Journal of Sport Management, 27(4), 316-328.
- Weinberg, R. S., & Richardson, P. A. (1990). Psychology of officiating. Leisure Press.
- Weir, G. (2022, September 10). Arkansas High School Football Game Put On Pause After Elderly Fan Tries To Attack Referee. OutKick. https://www.outkick.com/arkansas-high-school-football-fan-attacks-referee-friday-night-lights/. Accessed June 13, 2023.
- Wolfson, S., & Neave, N. (2007). Coping under pressure: Cognitive strategies for maintaining confidence among soccer referees. Journal of Sport Behavior, 30(2), 232-247.
- Yurkevich, V. (2023, May 18). America has an umpire shortage. unruly parents aren’t helping | CNN Business. CNN. https://www.cnn.com/2023/05/18/business/umpire-shortage-parent-behavior/index.html. Accessed June 13, 202