The Safety and Effectiveness of Supplement Use in Aviation

Submitted by Thomas E. Sather, CAsP (1) , Conrad L. Woolsey (2), Fred Cromartie (3), Marion W. Evans (4)

(1) Naval Aerospace Medical Institute, Pensacola, FL
(2) Logan University, St. Louis, MO
(3) United States Sports Academy, Daphne, AL
(4) University of Western States, Portland, OR

*Corresponding Author – Thomas E. Sather, CAsP

ABSTRACT
Aviation is an inherently dangerous endeavor. Pilots and aircrew are often directly responsible for aviation mishaps. Moreover, the added stressors such as air combat and fast paced operational tempo further complicate air safety. Due to the intense training and demands of the profession, military aviators are tactical athletes. Military aviation requires special levels of kinesthetic awareness, strength, endurance, eye-hand coordination, and timing. Similar to other highly competitive athletes, aviators often turn to nutritional supplements in attempts to enhance performance. This article reviews the safety and effectiveness of nutritional supplements. Additionally, civilian and military regulations related to the use of supplements in aviation are addressed.

KEYWORDS: Aerospace Physiology, Nutritional Supplements, Energy Beverages

INTRODUCTION
In the world of warfare, being athletic is important from an operational and tactical perspective. Pilots are categorized as athletes due to the fitness and performance standards they must meet on a biannual basis. In the military, the human body is considered as part of the operational weapons system. Whether pulling a trigger or engaging in hand-to-hand combat, the person is an intricate part of the system. Similar to how professional athletes use their bodies to perform in sport and to earn a living, military personnel train their bodies and minds for optimal performance and to survive and even thrive in combat.

Military personnel were once only trained to pass a general physical fitness test twice per year, but are now routinely trained for their job specific duties on a weekly basis. The Navy Operational Fitness and Fueling Series (NOFFS) is one example of new specialized functional training based on a specific skill sets needed. This paradigm shift in thinking marks the emphasis on functional training and the armed forces striving to improve their overall preparedness.

Aviation is inherently dangerous. Pilots are routinely involved in risky situations from take-offs to landings, to flying through thunderstorms. In civilian aviation, there are 16 fatal accidents per every million hours of general aviation, making flying about10 times as dangerous per mile travelled (1). Military pilots fly missions that may involve air-to-air combat (dogfighting), support of ground forces with strategic, low-level bombing or strafing runs, or even searching out enemy missile defenses. In the case of Naval Aviation, aviators must also take off and land on an aircraft carrier at sea, in various environmental conditions.

Military aviators are routinely subjected to environmental stressors as a consequence of mission requirements, airframe, and duty locations. Long duration missions crossing multiple time zones, unusual duty hours, barometric pressure changes, temperature extremes, vibration, noise and G-forces also contribute to increased levels of physical and mental fatigue/stress. Deployed military members often attempt to cope by using energy enhancing supplements to address these actual and perceived reductions in mental and physical performance (2).

Military pilots and aircrew are “tactical” athletes and as such need to be specifically trained to combat the hostile environment they work in. In technical terms, aviators need to be able to perform under environmental conditions that are a combination of high-Gravity force (G-force), low-level (altitude) maneuvers, and conventional 3-dimensional car racing. In NASCAR, drivers experience a maximum of 3 G’s (a measurement of acceleration felt as weight) travelling at over 200 miles per hour; whereas pilots may be subjected to over 12 G’s and travel at speeds faster than the speed of sound. They must also make split-second decisions that mean the difference between life and death. As a result, aircrew must maintain adequate levels of physical fitness. Moreover, the combined effects of a shrinking military force and the expansion of individual operational duties, flight personnel are often over extended with training, deployments, job requirements, and family duties. The cumulative stress of this balancing act can negatively impact performance as well as the safety of missions.

AIRCREW SUPPLEMENT USE
One of the biggest mistakes athletes make is overtraining. Overtraining can lead to injury, staleness, burnout, and ineffective performances. Often the outdated philosophy of ‘more is better’ is incorrectly implemented in training. Rather than taking needed breaks and getting adequate rest, athletes often turn to nutritional supplements with beliefs/hopes that supplements will prevent or minimize the effects of not getting adequate rest.
It appears that the use of nutritional supplements by military members follows trends from the general population. In the United States, research suggests that over half of the adult population (aged 20 years or older) uses or has used supplements (3). Self-reported surveys on various military groups indicate that between 60-85% use or have used supplements (4). Moreover, in surveys administered to deployed personnel, 47% reported using at least one type of supplement and 22% reported using multiple supplements (2). Additionally, research indicates greater use of energy enhancing supplements among deployed military members. This finding is not surprising given that it is relatively common for combat troops to be sleep deprived and given the operational tempo they are expected to maintain. This is especially concerning as military members often work in extreme environments and supplements can interfere with normal physical and mental performance.

In the aviation environment, commonly used supplements can have unforeseen effects. These effects, which would not be an issue for personnel working on the ground, could potentially have catastrophic consequences. For example, as a result of supplement use, a Navy pilot has temporarily blacked out before during ‘final approach’. In this incident, the pilot had recently started a vitamin regimen which contained vitamin B-3 (niacin) and Coenzyme Q10 (a commonly used antioxidant). It was later discovered that the combination of niacin and Coenzyme Q10 can cause a drop in the blood pressure and peripheral vascular resistance, which resulted in reduced G-force tolerance. This unexpected drop in G-tolerance may well have caused a crash had the pilot not aborted landing at the last minute (5).

Military Regulations on Supplement Use
A cursory review of regulations on the use of nutritional supplements has revealed a fragmented approach. The Federal Aviation Administration (FAA) places no limitations on the use of supplements as they are not treated as medications to be regulated (6).

Within the Department of Defense (DOD), regulations on the use of over-the-counter (OTC) supplements vary from service to service. The United States (US) Coast Guard ascribes to limitations set by the Food and Drug Administration (FDA) and National Collegiate Athletic Association (NCAA). In the US Air Force, the decision on which supplements are allowable is left to the discretion of the flight surgeon (7).

The US Army and Navy both place more limits on the use of supplements on pilots and aircrew. The US Army requires that all pilots report any supplement use to their flight surgeon. The Army also classifies nutritional supplements as falling within one of three categories (i.e., Class 1, 2, or 3) with specific limitations for use associated with each. Class 1 supplements can be used without approval of a flight surgeon. These supplements include single daily multivitamin/minerals, vitamin C, E, B6, B12 (oral), calcium, folate, protein supplementation, including shakes, capsules, and nutritional bars. Pilots must declare the use of all Class 1 supplements in writing on the Flying Duty Medical Examination (FDME) / Flying Duty Health Screen (FDHS). Class 2 supplements include vitamins A, K, D, niacin, riboflavin, thiamine, magnesium, zinc, chromium, selenium, copper, glucosamine with or without chrondroitin, echinacea, saw palmetto, creatine, and ginseng. These substances can be used only with approval of a flight surgeon and must be declared on the FDME/FDHS. Class 3 supplements are any other supplements that are not previously listed and are not authorized for use.

The US Navy provides the most extensive guidelines for nutritional supplement use. However, the Department of the Navy does not have a specific policy on the use of supplements. Navy and Marine Corps aviation is controlled by the Chief of Naval Operations and Instructions 3710.7U which states, “Use of nutritional/dietary and other OTC supplements/products by flight personnel except those approved by BUMED is prohibited. Flight Surgeons shall be consulted to assist with making informed decisions regarding nutritional supplements. The use of nutritional supplements of all types shall be reported to the flight surgeons and recorded during every periodic physical examination or physical health assessment (PHA).” Therefore, flight surgeons defer to the Aeromedical Reference and Waiver Guide (ARWG) to determine which supplements are authorized for use by pilots and aircrew (8). The US Navy ARWG is published by the Naval Aerospace Medical Institute and classifies nutritional supplements as belonging to one of three categories similar to that of the Army. Class A supplements are authorized for use by aviation personnel without restriction as long as they are disclosed during the physical. These include sports drinks, multivitamins, protein supplements, and tonic water. Class B supplements are more restrictive and require a positive diagnosis of a medical condition prior to clearance for use. The supplements in this category are glucosamine with or without chondroitin for arthritis, and saw palmetto for benign prostate hyperplasia. Anything else that is not explicitly permitted is classified as a Class C supplement and is not authorized for use. Personnel taking these substances should be removed from aviation duty for a minimum of 24 hours after the last dose of the substance.

AVIATION-SAFE SUPPLEMENTS
In reviewing the supplements authorized for use by flight crews, there are three general groups of supplements that are commonly used by aviators. The first are general nutritional supplements that include traditional multi-vitamins, minerals, and essential nutrients. The second list includes nutritional derivatives of protein and carbohydrates. The third are herbs or other “natural” compounds that are advertised to impart some type of physiological enhancement such as more energy, speed in healing, or boost in immune functions.

From a safety perspective, there appears to be no limit as to the quantity or quality of vitamins and mineral supplementation. While generally regarded as safe (GRAS), this overly permissive policy is one area of concern. The unregulated use of vitamins and minerals may lead to occurrences of hypervitaminosis as individuals consume supplements with high quantities of vitamins in the hopes of either enhancing endurance or improving energy levels. One nutritional supplement that contains massive doses of vitamins is energy shots. Some energy shots have in excess of 8000% of the RDA for certain B vitamins per two ounce bottle.

Protein and carbohydrate supplementation has been studied by sports researchers for decades. Both macronutrients have been proven safe and useful in optimizing physical performance in athletes. Since aviators typically use both protein and carbohydrate supplements, it is warranted that these products be adequately evaluated for safety.

Protein Supplements
Proteins are made up of individual amino acids and are used to make up most biologically active tissues. There are nine amino acids that that body cannot produce and therefore must be consumed daily. The body can combine different amino acids with carbohydrates, fats, and ammonia in different configurations to create what it needs. Some animal and human studies even present several plausible mechanisms through which specific amino acids may decrease the risk of diseases such as coronary heart disease (9). Literature reviews indicate that protein intake at the levels set by the FDA seem insufficient for athletes to maintain a positive nitrogen balance. This balance is important as it serves as an indirect measure of whether the body is repairing and building muscle (anabolism) or tearing it down (catabolism). For an athlete, it is imperative that they maintain a positive nitrogen balance as this ensures the body is adequately repairing itself and building verses breaking down its natural resources for energy.

Protein, when taken in large quantities, could be detrimental to the human body. Theoretically, ingestion of large amounts of protein stresses the liver and kidneys and could lead to pathological changes in kidney function as a result of the deamination of proteins and disposal of the extra nitrogenous waste (10). It has been suggested that excessive protein intake leads to a progressive impairment of kidney functions (11). These findings are applicable when dealing with a patient population with kidney disease or dysfunction; however, evidence does not support these findings in healthy populations (12). While experts have not determined the upper limits of safe protein intake, caution is warranted when exceeding the 2.0 gram per kilogram per day intake level (13).

Phosphocreatine
Phosphocreatine is a naturally occurring compound that could potentially enhance training by increasing energy storage. Creatine has the ability to increase energy transport by acting as a phosphate donor. By donating a phosphate to the active muscle, adenosine diphosphate can be synthesized into adenosine triphosphate (ATP). ATP is used for muscle contractions. The extra reserve of energy can allow for a longer and harder training session as long as the athlete stays fully hydrated. These ergogenic effects in turn can allow for improvements in strength and body mass (14). Creatine may not be beneficial for every type of training. While strength athletes have made good gains by using creatine, the same cannot be said for endurance athletes such as marathon runners or cyclists (15).

Sports Drinks
Sports drinks consist of water, carbohydrates, and electrolytes and are relatively safe to use. They have been shown to help performance during continuous activity lasting longer than 90 minutes because they are absorbed faster than water. They also contain electrolytes, which stimulate thirst and help retain water (16).
To ensure that the muscles have enough fuel to perform a task, carbohydrate replacement products can be consumed at periodic intervals. Research suggests that in endurance type sports, the optimal blend of carbohydrates is a mixture of the different types of sugars (17). Once those fuels are used up, it is imperative to refuel. Carbohydrates are the easiest for the body to use and digest. Research has shown that the optimal window to resupply muscles with carbohydrates is soon after exercise. This helps with restoring our glycogen stores. Additionally, the recovery process and metabolic absorption of protein is improved with carbohydrate intake directly after exercise (18). This is an especially important for athletes that are on a low carbohydrate or calorie restricted diet.

Herbal Supplements
One of the most contested categories of nutritional supplements used by aviators is herbs and natural compounds. The premise behind this category of supplements is that these substances will impart some sort of physiological enhancement. Most herbal supplements that can stimulate the body are not authorized for use by aviators. Herbal stimulants such as ephedrine and 1,3-dimethylamylamine (AKA: DMAA, methylhexanamine, or geranium extract) have been removed from the market due to numerous health issues associated with the use of these products. One exception to the prohibition of herbal stimulants is caffeine.

Caffeine
Caffeine is classified as a methylxanthine and stimulates the nervous and cardiac systems while at the same time relaxing smooth muscle cells. Xanthene use is not unusual in civilized society and is one of the most commonly used drugs on a daily basis (19). These chemicals are routinely consumed by the general population and are relatively safe if used in moderation. In some populations, xanthenes may contribute to anxiety (20). Methylxanthines are also used by asthma and pulmonary patients as a bronchodilator (21). Caffeine has been researched substantially and has been shown to be a potent ergogenic that can enhance endurance with restricted use. Recent research even suggests that caffeine has antioxidant effects and may help protect people from diseases such as Alzheimer’s when consumed in moderate amounts (22). While caffeine is generally regarded as safe, mixing with other ingredients or consuming rapidly can be dangerous.

Energy Drinks
Energy drinks have become popular and contain large amounts of vitamins, amino acids, and caffeine. While not authorized for use by flight personnel, their presence in convenience stores and military commissaries is concerning. With the introduction of these products, caffeine poisoning or overdose has become more common in the civilian sector (23). Caffeine toxicity can mimic amphetamine poisoning and lead to seizures, psychosis, cardiac arrhythmias and potentially death. According to research conducted in Australia, a majority of the emergency calls involving energy drinks were received between 5pm and 3am with the consumer drinking an average of five energy drinks (24). Ironically, this happens to be the time when party-goers and study-crammers likely seek the advertised ‘energy boost’ of these drinks.

SUMMARY & CONCLUSION

Research shows that supplement use by aviation personnel follows the same usage patterns seen in the general population. In combat deployed troops, there are a number of findings regarding the use of nutritional supplements that make logical sense. The finding that more deployed military members used energy enhancing supplements is not surprising given the operational tempo typical of combat duty. It is relatively common amongst combat troops to be sleep deprived. Additionally, the use of protein supplementation by deployed personnel was also not alarming given that combat personnel must maintain strength for carrying equipment, body armor and personnel supplies.

In the realm of military aviation, it is not surprising that there variations in standards related to the use of supplements. Divided into four service branches, each has different policies governing the use of supplements. As supplements are not well regulated by the federal government as is drugs, it falls to each service branch to establish policies. Additionally, since supplement products often rapidly change, it is almost impossible for any federal agency to survey new products and determine efficacy. The branch medical chiefs seem more comfortable in deferring to policies of outside agencies such as the NCAA or even the United States Olympic Committee in order to survey product safety. While this is a good start, it does not explore the special aeromedical concerns such as effects at altitude, G-forces, and other aspects of military readiness in aviation personnel. It will take continued effort by military medical officers to tackle this issue given the continuous advancements in sports nutrition and the billion dollar marketing efforts of the supplement industry.

Since nutritional supplements cannot be regulated as drugs, efforts must be focused to educate pilots and aircrew while continuing to research the physiological effects of supplements. It is important to realize that there will never be a way to regulate human behavior, dietary habits, and the use of nutritional supplements without major changes in governmental legislation. However, through health education and regulations, we can influence the behavior of service personnel thereby potentially reducing the adverse risks of supplementation while optimizing health and wellbeing.

REFERENCES

1. Greenspun, P. (2002). General aviation safety. Retrieved from http://philip.greenspun.com/flying/safety
2. Jacobson, I.G., Horton, J.L., Smith, B., Wells, T.S., Boyko, E.J., Lieberman, H.R., Ryan, M.A.K., & Smith, T.C. (2012). Bodybuilding, energy, and weight-loss supplements are associated with deployment and physical activity in U.S. military personnel. Annals of Epidemiology, 22(5), 318-330.
3. Rock, C. (2007). Multivitamin-multimineral supplements: Who uses them? American Journal of Clinical Nutrition, 85, 277-279.
4. Arsenault, J. & Kennedy, J. (1999). Dietary supplement use in US army special operations candidates. Military Medicine, 164(7), 495-501.
5. Barker, P.D. (2011). Reduced G tolerance associated with supplement use. Aviation, Space, and Environmental Medicine, 82(2), 140-143.
6. Medication class – dietary supplements/herbal preparations/vitamins. (n.d.). Retrieved from http://aviationmedicine.com/medications/index.cfm?fuseaction=medicationDetail&medicationID=19
7. U.S. Air Force, Physical Examinations and Standards, “Attachment 7. Medical Standards for Flying Duty,” Washington, D.C.: U.S. Air Force, AFI 48-123, May 22, 2001, Section A7.32.3.8.
8. Naval Aerospace Medical Institute, U.S. Navy Aeromedical Reference and Waiver Guide, “General Dietary Supplement Advice”, Pensacola, FL, not dated. As of March 5, 2013: http://www.med.navy.mil/sites/nmotc/nami/arwg/Pages/default.aspx
9. Wojcik, O.P., Koenig, K.L., Zeleniuch-Jacquotte, A., Costa, M. & Chen, Y. (2010). The potential protective effects of taurine on coronary heart disease. Atherosclerosis, 208(1), 19-25.
10. Martin, W.F., Armstrong, L.E., & Rodriguez, N.R. (2005). Dietary protein intake and renal function. Nutrition & Metabolism, 2(25). doi:10.1186/1743-7075-2-25
11. Metges, C.C. & Barth, C.A. (2000). Metabolic consequences of a high dietary-protein intake in adulthood: assessment of the available evidence. The Journal of Nutrition, 130, 886-889.
12. Yanagisawa, H. & Wada, O. (1998) Effects of dietary protein on eicosanoid production in rat renal tubules. Nephron, 78(2), 179 –186.
13. Brändle, E., Sieberth, H.G., & Hautmann, R.E. (1996). Effect of chronic dietary
protein intake on the renal function in healthy subjects. European Journal of Clinical Nutrition, 50, 734 –740.
14. Williams, M.H., Kreider, R.B., & Branch, J.D. (1999). Creatine: The power supplement. Champaign, IL. : Human Kinetics.
15. Cooper, R., Naclerio, F., Allgrove, J., & Jimenez, A. (2012). Creatine supplementation with specific view to exercise/sports performance: an update. Journal of the International Society of Sports Nutrition, 9, 33.
16. Jeukendrup, A.E. (2004). Carbohydrate intake during exercise and performance. Nutrition, 20, 669–677.
17. Currell, K., & Jeukendrup, A.E. (2008). Superior endurance performance with ingestion of multiple transportable carbohydrates. Medicine & Science in Sports & Exercise, 40(2), 275-81.
18. Greden, F. (1974). Anxiety or caffeinism: A diagnostic dilemma. American Journal of Psychiatry, 131(10), 1089-1092.
19. Tilley, S.L. (2011). Methylxanthines in asthma. Handbook of Experimental Pharmacology, 200, 439-456. doi: 10.1007/978-3-642-13443-2_17
20. Martinez-Lagunas, V., Ding, Z., Bernard, J.R., Wang, B. & Ivy, J.L. (2010). Added protein maintains efficacy of a low-carbohydrate sports drink. Journal of Strength and Conditioning Research, 24(1), 48-59.
21. Stratton, C.J. (1980). The xanthenes: Coffee, cola, cocoa, and tea. BYU Studies, 20(4), 1-16.
22. León-Carmona, J. R., & Galano, A. (2011). Is Caffeine a good scavenger of oxygenated free radicals? Journal of Physical Chemistry, 115(15), 4538. doi: 10.1021/jp201383y
23. Substance Abuse and Mental Health Services Administration, Center for Behavioral Health Statistics and Quality. (2011). The DAWN Report: Emergency Department Visits Involving Energy Drinks. Rockville, MD.
24. Soppe, R. (2012). Emergency calls highlight energy drink danger. Cosmos. Retrieved from http://www.cosmosmagazine.com/news/5175/emergency-calls-highlight-energy-drink-
danger

2015-12-09T15:37:08-06:00October 9th, 2013|Aerospace Physiology|Comments Off on The Safety and Effectiveness of Supplement Use in Aviation

Assessing Value of the Draft Positions in Major League Soccer’s SuperDraft

 

Abstract

This paper assigns various performance  measures to players who have been drafted in the SuperDraft of Major League Soccer. These measures are then used to assess the value of draft position. As a by-product of the analysis, we provide an estimate of the trajectory of player performance in a soccer career. Both the valuation of draft position and the career trajectory analysis may be important tools for general managers in Major League Soccer.

INTRODUCTION

By all measures, soccer (or football as it is more commonly known) is the most popular sport in the world (The Economist 2011). In the United States and Canada, the highest level of soccer is played in Major League Soccer (MLS). As of 2012, MLS consisted of 19 clubs divided into the Eastern Conference (10 teams) and the Western Conference (9 teams). Unlike the traditional European fall-to-spring schedule, the MLS season begins in March and ends in November. The MLS team with the best regular  season record is the recipient of the Supporters Shield and the winner of the MLS playoffs receives the MLS Cup.

There are various ways that  MLS teams acquire players for their rosters. One such mechanism is the annual SuperDraft  whereby players are placed on the draft-eligible list via nomination from MLS clubs. Most of these players are US college players. Players are then drafted by MLS teams in the inverse order of team performance from the previous  season. The ordering is an attempt to improve competitive balance within the league. The number of players drafted has varied since the inception of the SuperDraft in 2000. In the most recent draft of 2012, 38 players were drafted (two rounds involving the 19 MLS clubs).

The primary problem considered in this paper is the valuation of draft order in the SuperDraft. This is a fundamental problem for general managers in MLS. Consider the following hypothetical scenarios where the knowledge of draft value would be useful:

Your team has a glaring weakness at fullback and you have the 20th pick in the draft. What are the chances that the draftee can satisfy your needs at fullback? Would it be a better strategy to fill this position via a trade or via a designated player?

Your team is facing salary cap constraints and you have the 10th pick in the draft. What is the salary expectation for the player?

Your team has the draft rights for both the 10th and 11th picks. Would it be in your interest to trade both of these picks for the first draft pick?

The valuation of draft order was first considered in the context of the annual draft of the National Football League (NFL). Armed with a draft value chart, Jimmy Johnson (coach of the Dallas Cowboys) made informed trades on draft day in 1991, acquiring a whopping 19 players for the Dallas Cowboys. These informed trades eventually turned the team’s fortunes around as Dallas won three Superbowls within the next five years. Moskowitz and Wertheim (2011) provide an entertaining account of the use of draft value charts in the NFL.

The early chart was constructed according to the value of draft picks based on actual trades that took place. Massey and Thaler (2010) investigated the chart, and using data based on future salary contracts, determined that the early chart overvalued high draft picks. For example, although the first draft pick is valuable, the early chart suggested that the first pick is more valuable than is actually the case. Shuckers (2011) corroborated the overvaluation associated with the early draft chart via alternative measures of player performance. Shuckers (2011) subsequently proposed an alternative draft value chart. In other sports with drafts, Berry (2001) has looked at the success of first round picks. However, it does not appear that there has been any published investigation of the value of draft order in the MLS SuperDraft.

One of the complicating factors in assessing the value of draft order in the SuperDraft is that many of the players who have been drafted have not yet reached their peak level of play. Although some players when drafted in their early 20’s are unable to make an immediate contribution, through training and experience, they eventually become serviceable MLS players. We therefore want to be able to assess the future value of draft picks.

In section 2, we address this problem by estimating career trajectories of soccer players. Common sense dictates that players generally improve early in their career, then peak, and finally experience a decline in performance. The age at which they peak, and the extent of their improvement/deterioration  around the peak is the focus of section 2. Careful data collection is required to assess player productivity. Although the estimation of career trajectories is a necessary step in assessing draft order value, the problem itself is one of considerable interest to general managers. For example, what length and value of a contract should be offered to a player who is two years past his peak?

In section 3, we assess the value of draft position. The primary difficulty in the exercise is the determination and collection of performance measures. Clearly, a common metric such as “goals scored” is not relevant to all positional players. For example, defenders are not expected to score goals. The end product of our analysis are graphs of value plotted against draft position. Various graphs are provided based on various performance measures. With such graphs, one can assess for example, the relative value of the 20th draft pick to the first draft pick. We conclude with a short discussion in section 4.

CAREER TRAJECTORIES IN SOCCER

Assessing performance in soccer is not a straightforward task. For example, although goals scored is a popular and important statistic, it is not relevant to all positional players, especially defenders. Also, imagine a player who changes teams and experiences a surge in productivity. This may have more to do with circumstances surrounding his new team than an improvement in his personal play. In this section we make a number of subjective and hopefully reasonable decisions with respect to assessing player performance. Yearly performance data coupled with age data will help us to evaluate career trajectories  in soccer.

We began by considering players who have played on top flight clubs for a period of at least five consecutive seasons. We have chosen 12 teams from Europe which have been traditional footballing powers. The rationale is that these clubs are of the highest quality and consistency. Therefore an observed change in performance when competing for these clubs is assumed to convey a change due to the player. We have restricted our analysis to the “modern” era of soccer beginning with the 1992/1993 season when the English Premier League was formed. We have excluded goalkeepers from the analysis as it is well known that keepers can remain competitive at more advanced ages. For example, Edwin van der Sar retired as keeper from Manchester United following the 2010/11 season at 40 years of age. Although players from the 12 chosen clubs are of exceptional quality, we assume that the average career trajectory for players at these clubs is not unusual.For example, this implies that the average peak age for players at the elite clubs should be the same as the average peak age for all professional soccer players.

From the websites www.footballdatabase.eu  and www.bdfutbol.com/en/e/e.html we identified 232 players who met our criteria. These players played a total of 1791 seasons. We were also able to collect seasonal performance data on each of the players in terms of minutes played. Although minutes played does not capture all of the elements of performance, it is clearly a sensible measure of worth. The data are summarized in Table 1.

Team League No. Players
Arsenal English Premier League 25
Chelsea English Premier League 11
Liverpool English Premier League 23
Manchester United English Premier League 25
Bayern Munich German Bundesliga 26
AC Milan AS Italian Serie A 20
Roma Italian Serie A 18
Internazionale Italian Serie A 14
Juventus Italian Serie A 18
Barcelona Spanish La Liga 20
Real Madrid Spanish La Liga 16
Valencia Spanish La Liga 16
Overall 232

 

Table 1: Summary data for players who have played at least five consecutive years with a top flight club sometime during the 1992/93 through 2011/12 seasons.

Recall that our objective in this section is the evaluation of career trajectories. Therefore, we want to assess individual player performance at different ages where player performance is measured against himself. Accordingly, let xij denote the minutes played for the ith player at age j in the season where the player was j years old on January 1. The beginning of January is roughly halfway through the traditional fall-spring soccer season. Corresponding to xij, let wij be the number of available minutes during the season where wijis the product of 90 minutes and the number of games  that his team played in the season. We then define zij= xij/wij as a performance statistic for the i the player in the given season as it represents his proportion of available minutes on the field. To provide a personal measure of performance for the ith player at age j, we define

Formula

where the maximum is taken over all of his active seasons at the club. Therefore the personal performance measure ppij for the i player has a maximum value of 100% in at least one of his seasons. Note that we only considered matches played in the domestic  season. Our rationale for this choice is that other matches (e.g. friendlies, FA Cup, Europa League, Champions League, etc) may not have a consistent level of competition. Also, it is well known that players are often given rest when matches are scheduled in frequent succession.

In Figure 1, we provide a scatterplot of the personal performance measure ppij versus age j based on minutes played for all players over all seasons. The plot consists of 1791 points. Although there is considerable variability in the scatterplot, the lowess function describes the overall trend. The shape of the lowess plot corresponds to our intuition where performance improves early in a career, then peaks, and concludes with a period of decline. We observe that typical player performance peaks at roughly 24-27 years of age. Also, the drop off is minimal for roughly two years surrounding the peak period. The improvement early in a career is more rapid than the decline at the end of a career. We note that although the peak period of 24-27 years appears to be in rough agreement with common opinion (www.forum.ea.com/uk/posts/list/802432.page), we know of no quantitative study that has provided  such an interval. A miscalculation by even a couple of years can have dire consequences for general managers when deciding upon long term contracts. The parameters of the lowess function were set according to span=0.5 and degree=2 which is consistent with the analyses of Shuckers (2011). The choice of the span parameter appears reasonable as we do not want large fractions of the data to fit local segments of the trajectory curve. For example, the trajectory at young ages does not likely have much to do with longevity. The degree parameter  should also take a value exceeding 1 since we do not expect linear segments in the trajectory curve. Setting degree=2 provides more curvature.

Figure 1

Figure 1:  Scatterplot of the personal performance  measure ppij based on minutes played versus age. A lowess fit is included to help assess the overall trend.

Recall that each player has at least one plotted value of 100%. Accordingly, there is an inherent assumption that data are collected over a period that includes each player’s peak years of play. The assumption is valid for most players since it is unlikely that a player had five consecutive years of form that were all below peak performance, yet he managed to play on one of these top flight teams. However, to check the robustness of the assumption, we have repeated the analysis based on a restricted subset of 129 players  who played at least seven consecutive seasons with one of the 12 top flight clubs. These players played a total of 1229 seasons. A greater period of seasons improves the chance of capturing a player’s peak year. We found no meaningful difference in the resultant plot when compared to Figure 1. Related to the assumption, we encountered 9 players (e.g. Zinedine Zidane) who played at least five years on each of two teams from our list. In these cases, we only retained the years at the club where the player was 26 years of age. In the case of Zidane, we used his Juventus years instead of his years at Real Madrid.

How do we interpret the vertical scale in Figure 1? From 24-27 years of age, an average player operates at roughly 75% of top performance. Similarly, an average 34 year old operates at roughly 50% of top performance. Therefore, we might view the 35 year old as being able to contribute 50/75 two thirds of what he was able to contribute at his peak. Here, the measure of contribution can be interpreted in minutes played.

ASSESSING VALUE  OF  DRAFT POSITION

In this section we investigate the relationship between player value and draft position in the MLS SuperDraft. To facilitate the investigation, www.wikipedia.org/wiki/MLS  SuperDraft provides the entire history of the MLS SuperDraft going back to the inaugural draft on February 6, 2000. The list consists of a total of 745 players chosen in the 13 drafts from 2000 through 2012. The number of players drafted per year ranges from 72 (2001) to 38 (2012).

Whereas obtaining the draft position of each player is uncontroversial and routine, the determination of player value is far from straightforward. As in section 2, we first consider value measures based on minutes played. Another indicator of player value which we consider is yearly salary. Although players can be underpaid or overpaid in a given contract, subsequent player contracts tend to adjust to reality. A difficulty  with using salary as a proxy for performance is that there are time lags between observed performance and contract. Fortunately, for the MLS, there are good sources of data. For minutes played, we made use of http://socceroutsider.com/ and player’s personal Wikipedia sites. For salary information, data are available for the six seasons 2007 through 2012 at www.mlsplayers.org/salary info.html. We had to dig deeper for earlier seasons, referring to www.washingtonpost.com/wp-srv/sports/mls/longterm/2006/mls.salaries.html for the 2006 season, www.bigapplesoccer.com/article.php?article id=3103 for the 2005 season and http://sportsillustrated.cnn.com/2004/soccer/01/06/mls.salaries.sa/  for the 2004 season.

Before the various value metrics are introduced, we indicate some general problems that need to be addressed with respect to player valuation:

A spectacular  season is valuable to a club. There is also value in a longstanding career. How do we balance short term performance with longevity?

How do we assess a player who was drafted in the SuperDraft but went on to play in some other league? For example, Clint Dempsey was drafted 8th in the 2004 SuperDraft by the New England Revolution. However, since 2006/07, Dempsey has played in the English Premier League for both Fulham and Tottenham. Clearly, Dempsey is a valuable player although he has only limited MLS data.

In our current list of drafted players, some players are still young and have not yet reached their full potential. Should we assess their value on some combination of current performance and future performance? The career trajectory plot Figure 1 may be helpful in this regard.

With the growth of the MLS, there has been an escalation in salaries over time. How do we compare a salary from the early years to recent salaries?

To facilitate a comparison of various metrics, we define each metric on a scale of 0 to 100. We begin by considering minutes played in regular season MLS matches. The restriction to regular season matches levels the comparison amongst players since each team has the same number of games of comparable importance. For each player, we calculated his percentage of total minutes played relative to available minutes in a season. This was done for each year over all of his MLS seasons. We then defined the player performance metric y1 for a given player as his maximum percentage over his MLS career. We also defined the player performance metric y2 for a given player as his average percentage over his three best MLS seasons. Therefore, the measure y2 favours career longevity over y1.

In the case of players who have gone on to play in ldquo;superior” leagues, we arbitrarily assign a percentile rank of 90% in seasons where they played in superior leagues. We define a superior  league as any of the four famous leagues listed in Table 1. Players who have made it to one of these four top flight leagues have typically developed in the MLS before making their jump to the big time. Although there are other leagues that many football fans would agree are better than the MLS (e.g. Liga Portuguese (Portugal), Ligo Do Brasil (Brasil), Ligue One (France), Primera Liga (Argentina), Eredivisie (Holland)), very few MLS drafted players have gone on to play in these professional leagues. When an MLS draftee plays in leagues other than the MLS or one of the four top flight leagues, we assign a percentile rank of 0% for those seasons. A 0% score is also assigned to players who discontinue playing. A rationale for the 0% performance score is that it was a mistake to draft such a player as they did not contribute to the MLS team that drafted them. In our list of MLS drafted players, only 12 played in superior leagues. Of the 339 that played in other leagues, 277 played in the NASL (North American Soccer League) or the USL (United Soccer Leagues) which can truly be viewed as lower quality leagues compared to the MLS. When a player belonged to multiple leagues in a year, we used the league where he played most of his games.

To account for young players who have not yet reached their top level of performance (i.e. less than 24 years of age), we imputed values for their unobserved seasons. For example, suppose that we have a 21 year old player in the MLS who has just completed a season. We take his minutes played as a 21 year old and multiply by l(22)/l(21) to obtain his predicted minutes as a 22 year old where l(x) is the value of the lowess function at age x in Figure 1. We do not allow predicted percentages to exceed 100%. The determination of player ages was not as straightforward as we had hoped; there were at least six additional websites that we accessed to collect birthdates.

An obvious difficulty with the minutes played variables y1 and y2 is that they do not account for team strength. For example, it is easier to play extended minutes on a poorer performing club than at a stronger club. Another difficulty with these measures is that there are a number of players who represent their club in nearly all of the regular season matches. Therefore minutes played does not adequately distinguish these players in terms of performance.

Our preferred performance metrics are based on salary data. Varying team strength is less of an issue when dealing with salary data since league-wide  salary caps exist. Salary caps help to impose a realism on salaries so that players are paid what they are worth. An exception are the salaries paid to designated players who are not MLS draftees. For each player, we calculated his percentile rank for a given year based on his salary relative to all MLS players in that year. Thus the comparison sensibly involves the performance of draftees against the population of MLS players. This was done for each year over all of his MLS seasons. We then defined the player performance metric y3 for a given player as his maximum percentile rank over his MLS career. We also defined the player performance metric y4 for a given player as his average percentile rank over his three best MLS seasons. We used the same rules as above in handling players who have gone on to play at superior clubs and for young players who have not yet reached their full potential. In the case of multi-year contracts, the amount that a player received in a year is used as his yearly salary.

In Figure 2, we provide a scatterplot of the preferred y4 metric versus draft position. To assess the overall trend, a lowess plot is superimposed. We observe the anticipated pattern that early draft picks have more value. The plot decreases rapidly during the early picks and then levels off. It is interesting that there is little additional value beyond draft position 25. What this suggests is that whereas general managers have good intuition of value early in the draft, late draft picks are more or less a crapshoot. It also suggests for example that managers should value a 50th draft pick as about equal to a 25th draft pick. If this sort of information is not well understood, a savvy manager may be able to trade a 25th draft choice for a 50th draft choice plus additional assets. We observe from the variability in the plot that it is still possible to draft a productive player late in the draft but the probability of doing so is much decreased. Moreover, the variability is greater for early draft picks. This suggests that that there may be great pressure for teams drafting early as an early draft choice can turn out to be either a star or a bust. With less expected of late draft picks, there may only be upside for a general manager. How might we interpret the vertical scale of the plot? According to the salary metric, the first draft pick provides you with a player who on average ranks in the top 85.6% of players in the MLS. The first draft pick is about 1.7 times as valuable as the 10th draft pick and is about 5.3 times as valuable as the 20th draft pick in terms of salary. Finally, we note that we obtain a very similar plot if y4 is based on the best four seasons rather than the best three seasons. For ease of reference, the values of the loess curve in Figure 2 are provided in the pick value chart given in Table 2 of the Appendix.

In Figure 3, we provide a comparison of the lowess plots using each of the four proposed metrics. We observe that each plot conveys similar information and this provides assurance that the valuations are meaningful. For example, all four plots indicate that the first draft pick injects a team with a player who on average will rank roughly in the top 80% of MLS players. The level of agreement in the four curves was a bit of a surprise to us as we were aware of the flaws in assessing value based on minutes played. For the most part, we also note that y1 dominates y2 and that y3 dominates y4. This suggests that the consideration of a single season (y1 and y3) tends to inflate a player’s value when compared to their performance over multiple seasons (y2 and y4). Finally, we note that the preferred metric y4 lies amongst the middle of the four lowess curves.

Figure 2

Figure 2: Scatterplot of the value metric y4 versus draft position. A lowess fit is included to help assess the overall trend.

DISCUSSION

The major contribution of the paper is the construction of Figure 1 and Figure 2. In Figure 1, we have estimated the performance trajectory of soccer players (excluding  keepers). The plot may be of value to general managers in planning team rosters and offering contracts. In Figure 2, we have estimated  the value of draft picks in the MLS SuperDraft. This may also be of value to general managers when planning rosters and assessing trades.

The major difficulty in both the construction of Figure 1 and Figure 2 is the determination of player value. Value is a subjective quantity and involves many factors including player age, the assessment of the importance of longevity, positional characteristics, the confounding of individual and team characteristics, changes in league salaries and missing data. We have attempted to handle these issues sensibly and we note that various value metrics have lead to similar results (see Figure 3). Data collection and data management also proved to be a substantial exercise in obtaining our results. It may be interesting to extend the work by restricting analyses to various positions (e.g. defenders, midfielders,  forwards) although this reduces the sizes of data sets and often introduces uncertainties with respect to the categorization of players.

Figure 3

Figure 3: Lowess plots for each of the value metrics.

Finally, a relatively new change may affect the future of the MLS SuperDraft. In 2006, the Home Grown player criteria was established in the MLS to nurture promising young players living in the vicinity of an MLS team. The designation requires commitment by players to practice/play sufficiently under the club’s development system. Teams may then sign a player to their first professional contract if the player has trained for at least one year in the club’s youth development program and has met the league’s Home Grown player criteria. The important implication is that such players do not participate in the SuperDraft. Therefore, although the Home Grown player program is currently in flux, should it gain widespread popularity, it may eventually dilute the quality of the SuperDraft.

APPENDIX

Pick    Value Pick    Value Pick    Value Pick    Value
01       85.6
02       81.5
03       77.5
04       73.5
05       69.5
06       65.6
07       61.7
08       57.9
09       54.2
10       50.5
11       46.8
12       43.2
13       39.7
14       36.1
15       32.7
16       29.2
17       25.4
18       21.9
19      18.8
20      16.1
21      13.5
22      11.3
23      09.6
24      08.3
25      07.3
26      06.3
27      05.7
28      05.4
29      05.1
30      04.8
31      04.7
32      04.6
33      04.3
34      04.1
35      04.0
36      03.8
37      03.6
38      03.5
39      03.5
40      03.4
41      03.3
42      03.3
43      03.3
44      03.2
45      03.1
46      03.1
47      03.1
48      03.0
49      02.9
50      02.7
51      02.6
52      02.5
53      02.3
54      02.2
55      02.0
56      01.9
57      01.7
58      01.6
59      01.4
60      01.2
61      01.1
62      00.9
63      00.7
64      00.6
65      00.4
66      00.2
67      0.00
68      0.00
69      0.00
70      0.00
71      0.00
72      0.00

 

Table 2: Pick value chart corresponding to the lowess curve in Figure 2.

 

 

REFERENCES

Berry, S.M. (2001). “Do you feel a draft in here?”, In the column, “A Statistician Reads the Sports Pages”, Chance, 14(2): 53-57.
Massey, C. and Thaler, R.H. (2010). “The loser’s curse: overconfi dence vs. market efficiency in the National Football League draft”, http://ssrn.com/abstract=697121.

Moskowitz, T.J. and Wertheim, L.J. (2011). Scorecasting: The Hidden Influences Behind how Sports are Played and Games are Won, Crown Archetype: New York.
Shuckers, M. (2011). “An alternative to the NFL draft pick value chart based upon player performance”, Journal of Quantitative Analysis in Sports, 7(2): Article 10.1
The Economist (2011). Game Theory blog post under “Ranking sports’ popularity: And the silver goes to …”, www.economist.com/blogs18

2017-11-02T13:56:36-05:00June 13th, 2013|Contemporary Sports Issues, Sports Management|Comments Off on Assessing Value of the Draft Positions in Major League Soccer’s SuperDraft
Go to Top