Skip to content

How Sports Scouting Works: Projection, Uncertainty and What Talent ID Research Shows

What scouts evaluate, why projecting a young player is harder than describing one, and what talent identification research says about selection accuracy.

By Published 7 min read

Reign Creative LLC makes 24-0 Rugby Draft Pro League and Pro Football GM Club Soccer, which this article links to, so we have a commercial interest in them. How we write and check articles.

AI-assisted article. Drafted with AI tools from the sources cited below and checked by automated tests and an AI editorial review. No person has reviewed it yet. How we write and check articles.

Key takeaways

  • Separate what a player does now from what you project they will become, and write down how confident each projection is.
  • Check a youth rating against the player's physical maturity and birth date before trusting it, because ratings can track development as well as skill.
  • Combine observation with structured data: in one study of 117 youth footballers, coach assessments combined with multidimensional measures gave the most accurate predictions of professional status.
  • Plan for selection to be repeated rather than one-off, since in German youth football fewer than half of squad members were still in a programme three years later.
  • On a draft board, treat every rating as an estimate and build depth where your confidence in the estimate is lowest.

Scouting turns watching into forecasting. A scout observes a player in matches, in training and on video, adds whatever test and performance data exist, and reports three things: what the player can do now, what they are likely to become, and how sure that projection is. The first is description, and it can be checked next week. The second is projection, and that is where the research finds most of the error. A systematic review of talent identification research found little agreement on which factors separate the athletes who go on to succeed, and in German youth football fewer than half of the players in a programme were still in it three years later.

The three layers of a scouting report

Every useful report, whatever the sport, separates three questions that are easy to blur together.

Layer The question What it rests on When it can be checked
Current level What can this player do now, against this standard of opposition? Matches, training, video, testing Almost immediately
Projection What will the player be in three or five years? Age, physical maturity, rate of learning, character, role Only years later
Confidence How much should anyone trust the projection? Number of viewings, consistency, context Across many reports, never one

Most arguments about a prospect are really arguments about the second and third rows dressed up as arguments about the first.

What recruiters say they weigh

Larkin and O'Connor asked 20 Australian regional youth technical directors and coaches, the people choosing players for under-13 representative soccer, to rate and justify the attributes they look for, in a three-stage Delphi process. The top of their hierarchy was technical (first touch rated highest, with striking the ball, one-versus-one ability and technique under pressure also rated very important), tactical (decision-making) and psychological (coachability and a positive attitude). Physiological, anthropometric and sociological qualities were emphasised less. They also said they judge technical skills in games and small-sided games, where players have less time and space on the ball.

That is a statement of what recruiters believe they do, from one country and one entry level. It is not a measurement of what drives their decisions, and the next section is where those two things part company.

How the criteria have shifted

A 2026 systematic review by Gong and colleagues traced 38 empirical studies of soccer talent identification from 1976 to 2024 and described three stages: an early period dominated by body measurements and basic fitness tests, a developmental period that added technical metrics to physiological testing, and a recent period of multidimensional assessment that brings in psychological attributes and social adaptability. The authors also found regional differences, with European systems generally emphasising data-driven precision and South American and African contexts more often prioritising latent potential shown in game-like conditions. They flag their own limits: English-language studies only, heterogeneous designs and no preregistration.

Why projection is the hard part

There is no agreed formula. Johnston and colleagues reviewed 20 longitudinal and retrospective studies comparing more and less successful athletes in elite sport. The literature leaned heavily towards physical profiles (60% of studies), male samples (65%) and athletes aged 10 to 20 (60%), and the factors that separated the groups varied widely from study to study. Their conclusion was that the findings highlight how little is known about talent identification in elite sport.

Selection is a repeated process, not a single verdict. Güllich tracked German national youth teams and youth academies and analysed the earlier careers of Bundesliga players. Mean annual turnover of squad members was 24.5% in the academies and 41.0% in the national youth teams, and at every age the probability of still being in the programme three years later was below 50%. Current Bundesliga players had been recruited at ages spread fairly evenly across childhood and youth. The professional cohort emerged from repeated rounds of selection and de-selection rather than from early identification followed by years of continuous development.

Ratings can track maturity as well as skill. Kelly and colleagues analysed 53 factors for 98 under-9 to under-16 players at an English academy. The features most associated with coaches' player review ratings included a more advanced percentage of predicted adult height, more match-play hours, two technical measures and being relatively older within the age group. For 18 under-18 players, psychological characteristics, including the ability to organise and engage in quality practice, contributed to winning a professional contract. The authors call the work exploratory, and the selection sample is small enough that the model may have memorised it. Set beside the recruiters' own account above, it is a reason to check any youth rating against a player's maturity and birth date before trusting it.

Eyes, tests, or both

The most direct comparison comes from Sieghartsleitner and colleagues. They assessed 117 under-14 footballers using coach assessments, motor performance tests and a broader multidimensional data set that also covered psychological characteristics, family support, training history and biological maturation, then checked who held professional status at under-19 level five years later. Twenty of the 117, or 17.1%, did.

They scored each approach by the area under the ROC curve, which here is the chance that a randomly chosen future professional was ranked above a randomly chosen player who did not turn professional: 0.5 is a coin toss and 1.0 is perfect.

Approach Area under the curve
Motor performance tests 0.71
Coach assessments 0.82
Multidimensional data 0.85
Coach assessments and multidimensional data combined 0.93

The tests alone did significantly worse than the multidimensional data, and the coaches did not differ significantly from either. Combining the coaches' eye with the data did best. Two cautions apply. The authors acknowledge that coaches help decide who becomes professional, which can make their assessments look more prophetic than they are, and the analysis summed data and used linear statistics.

The base rate puts those numbers in proportion. If a club could keep only 20 of these 117 players and chose at random, it would expect about 20 × 20/117 ≈ 3.4 future professionals among them; a perfect method would keep all 20. Every real method sits somewhere in between, and even the best combination in the study did not reach perfect discrimination. For why a good process still produces bad outcomes, understanding probability in sports simulations makes the same point about seasons.

The mistakes nobody sees

Johnston and Baker's review of selection decisions describes them as sometimes inaccurate, bias-driven and even illogical, and uses the term talent wastage for the cost of wrongly selecting or wrongly releasing an athlete. Their framing borrows sensitivity and specificity: how often selectors keep the athletes who would have succeeded, and how often they correctly release the ones who would not.

The awkward part is measurement. The authors note that it is nearly impossible to know whether the right athletes were selected or released. Part of the reason is simple: the career a released player would have had inside the programme never happens, so there is nothing to compare against. A club sees the misses it kept but rarely the ones it let go, so a selector's visible record is incomplete in a way that tends to flatter it.

Reading ratings on a draft board

24-0 Rugby Draft Pro League builds its board from a pool of more than 1,000 real players' careers, forwards, backs, specialists and goal kickers from different eras, and the app is explicit that its ratings and salaries are unofficial estimates. In other words, every number on its board is a scouting report rather than a measurement. The pool rotates, and position fit, value and depth matter as much as raw rating, so the research above translates into a handful of habits:

  1. Read a rating as a projection with a margin. Two players a few points apart may be indistinguishable once you allow for the error in the estimate.
  2. Buy certainty where a miss hurts most. A squad that cannot absorb one wrong evaluation, or one injury, will not survive a 24-match season under a $200M in-game salary cap.
  3. Tier, then choose. Group players you would be equally happy with, then decide between them on fit. What makes a good draft board sets out how.
  4. Value what the number cannot see. In Pro Football GM Club Soccer, position fit, playing style and squad balance all feed the result, so the highest-rated XI is not automatically the best one.

Two related pieces cover the edges of this: why a draft pool rotates explains why the board cannot be memorised, and what happens at a scouting combine looks at how physical testing influences decisions more than it forecasts careers. In both games the ratings are the games' own estimates and the simulated results are outcomes of their rules, not predictions about any real player.

More rules and research for each sport sit on our sports hub, and the draft and management games are listed under sports GM.

Good to know

Frequently asked questions

How does scouting work in sports?
A scout watches players in matches, training and on video, adds whatever test and performance data exist, and reports what the player can do now, what they are likely to become, and how confident that projection is. The current-level part can be checked against what the player does next week. The projection can only be checked years later, which is why it carries most of the uncertainty.
What do scouts look for in young players?
In one study, 20 Australian youth technical directors and coaches selecting under-13 representative players rated technical skills such as first touch, the tactical skill of decision-making, and psychological qualities such as coachability and a positive attitude as most important. Physical size and fitness were emphasised less. They said they judge technical skills in games and small-sided games.
How accurate is talent identification?
Less accurate than its confidence often suggests. A systematic review of 20 studies found high variability in which factors separated more and less successful athletes, and its authors note there is no clear set of variables that consistently predicts future success. In German youth football, mean annual squad turnover was 24.5% in academies and 41.0% in national youth teams, and fewer than half of players remained in a programme three years later.
Are coaches or fitness tests better at spotting talent?
In a study that followed 117 under-14 footballers for five years, motor tests alone predicted professional status significantly less well than a broad multidimensional data set, and coach assessments sat in between without differing significantly from either. Combining coach assessments with the multidimensional data predicted best of all. The authors note that coaches may also influence who becomes professional, which can flatter their assessments.
What is talent wastage?
It is the loss caused when selectors wrongly pick or wrongly release an athlete. Researchers describe selection decisions as sometimes inaccurate and bias-driven, and point out that it is nearly impossible to know afterwards whether the right athletes were kept. A released player's alternative path through the programme never happens, so there is nothing to check the decision against.

Sources

  1. Talent Identification in Sport: A Systematic Review (Johnston, Wattie, Schorer and Baker, Sports Medicine, 2018) — PubMed abstract (opens in a new tab)US National Library of Medicine (PubMed via NCBI E-utilities) — accessed
  2. Evolution of soccer talent identification criteria: a systematic review from global perspectives (1976–2024) (opens in a new tab)Frontiers in Psychology — accessed
  3. Talent identification and recruitment in youth soccer: Recruiter's perceptions of the key attributes for player recruitment (opens in a new tab)PLOS ONE — accessed
  4. Selection, de-selection and progression in German football talent promotion (Güllich, European Journal of Sport Science, 2014) — PubMed abstract (opens in a new tab)US National Library of Medicine (PubMed via NCBI E-utilities) — accessed
  5. A Multidisciplinary Investigation into the Talent Development Processes at an English Football Academy: A Machine Learning Approach (Kelly et al., Sports, 2022) (opens in a new tab)PubMed Central — accessed
  6. Science or Coaches' Eye? – Both! Beneficial Collaboration of Multidimensional Measurements and Coach Assessments for Efficient Talent Selection in Elite Youth Football (opens in a new tab)Journal of Sports Science and Medicine — accessed
  7. Waste Reduction Strategies: Factors Affecting Talent Wastage and the Efficacy of Talent Selection in Sport (opens in a new tab)Frontiers in Psychology — accessed

League, team and athlete names appear here only to identify the rules, records and history being discussed. Reign Creative LLC's sports games are not affiliated with, endorsed by or licensed by any league, team, players' association or athlete, and all names and marks belong to their owners.

About the author

— The independent app studio that builds the apps covered on this site and publishes every article here. On Google Play it publishes as Reign Collective Apps.

We use AI tools to help research, draft and edit our articles. Each article lists the sources its factual claims rely on, and details about our apps come from their live Google Play listings. No article on this site has been reviewed by an independent expert unless the reviewer is named on it.

No person at Reign Creative LLC has read this article in full. It was published after automated checks and an AI editorial review, which are described in our editorial policy and are not the same as a person reading every sentence.

Spotted an error? Tell us — how corrections are handled is set out in our editorial policy.

Apps mentioned in this article