Key takeaways
- Separate what a player does now from what you project they will become, and write down how confident each projection is.
- Check a youth rating against the player's physical maturity and birth date before trusting it, because ratings can track development as well as skill.
- Combine observation with structured data: in one study of 117 youth footballers, coach assessments combined with multidimensional measures gave the most accurate predictions of professional status.
- Plan for selection to be repeated rather than one-off, since in German youth football fewer than half of squad members were still in a programme three years later.
- On a draft board, treat every rating as an estimate and build depth where your confidence in the estimate is lowest.
Scouting turns watching into forecasting. A scout observes a player in matches, in training and on video, adds whatever test and performance data exist, and reports three things: what the player can do now, what they are likely to become, and how sure that projection is. The first is description, and it can be checked next week. The second is projection, and that is where the research finds most of the error. A systematic review of talent identification research found little agreement on which factors separate the athletes who go on to succeed, and in German youth football fewer than half of the players in a programme were still in it three years later.
The three layers of a scouting report
Every useful report, whatever the sport, separates three questions that are easy to blur together.
| Layer | The question | What it rests on | When it can be checked |
|---|---|---|---|
| Current level | What can this player do now, against this standard of opposition? | Matches, training, video, testing | Almost immediately |
| Projection | What will the player be in three or five years? | Age, physical maturity, rate of learning, character, role | Only years later |
| Confidence | How much should anyone trust the projection? | Number of viewings, consistency, context | Across many reports, never one |
Most arguments about a prospect are really arguments about the second and third rows dressed up as arguments about the first.
What recruiters say they weigh
Larkin and O'Connor asked 20 Australian regional youth technical directors and coaches, the people choosing players for under-13 representative soccer, to rate and justify the attributes they look for, in a three-stage Delphi process. The top of their hierarchy was technical (first touch rated highest, with striking the ball, one-versus-one ability and technique under pressure also rated very important), tactical (decision-making) and psychological (coachability and a positive attitude). Physiological, anthropometric and sociological qualities were emphasised less. They also said they judge technical skills in games and small-sided games, where players have less time and space on the ball.
That is a statement of what recruiters believe they do, from one country and one entry level. It is not a measurement of what drives their decisions, and the next section is where those two things part company.
How the criteria have shifted
A 2026 systematic review by Gong and colleagues traced 38 empirical studies of soccer talent identification from 1976 to 2024 and described three stages: an early period dominated by body measurements and basic fitness tests, a developmental period that added technical metrics to physiological testing, and a recent period of multidimensional assessment that brings in psychological attributes and social adaptability. The authors also found regional differences, with European systems generally emphasising data-driven precision and South American and African contexts more often prioritising latent potential shown in game-like conditions. They flag their own limits: English-language studies only, heterogeneous designs and no preregistration.
Why projection is the hard part
There is no agreed formula. Johnston and colleagues reviewed 20 longitudinal and retrospective studies comparing more and less successful athletes in elite sport. The literature leaned heavily towards physical profiles (60% of studies), male samples (65%) and athletes aged 10 to 20 (60%), and the factors that separated the groups varied widely from study to study. Their conclusion was that the findings highlight how little is known about talent identification in elite sport.
Selection is a repeated process, not a single verdict. Güllich tracked German national youth teams and youth academies and analysed the earlier careers of Bundesliga players. Mean annual turnover of squad members was 24.5% in the academies and 41.0% in the national youth teams, and at every age the probability of still being in the programme three years later was below 50%. Current Bundesliga players had been recruited at ages spread fairly evenly across childhood and youth. The professional cohort emerged from repeated rounds of selection and de-selection rather than from early identification followed by years of continuous development.
Ratings can track maturity as well as skill. Kelly and colleagues analysed 53 factors for 98 under-9 to under-16 players at an English academy. The features most associated with coaches' player review ratings included a more advanced percentage of predicted adult height, more match-play hours, two technical measures and being relatively older within the age group. For 18 under-18 players, psychological characteristics, including the ability to organise and engage in quality practice, contributed to winning a professional contract. The authors call the work exploratory, and the selection sample is small enough that the model may have memorised it. Set beside the recruiters' own account above, it is a reason to check any youth rating against a player's maturity and birth date before trusting it.
Eyes, tests, or both
The most direct comparison comes from Sieghartsleitner and colleagues. They assessed 117 under-14 footballers using coach assessments, motor performance tests and a broader multidimensional data set that also covered psychological characteristics, family support, training history and biological maturation, then checked who held professional status at under-19 level five years later. Twenty of the 117, or 17.1%, did.
They scored each approach by the area under the ROC curve, which here is the chance that a randomly chosen future professional was ranked above a randomly chosen player who did not turn professional: 0.5 is a coin toss and 1.0 is perfect.
| Approach | Area under the curve |
|---|---|
| Motor performance tests | 0.71 |
| Coach assessments | 0.82 |
| Multidimensional data | 0.85 |
| Coach assessments and multidimensional data combined | 0.93 |
The tests alone did significantly worse than the multidimensional data, and the coaches did not differ significantly from either. Combining the coaches' eye with the data did best. Two cautions apply. The authors acknowledge that coaches help decide who becomes professional, which can make their assessments look more prophetic than they are, and the analysis summed data and used linear statistics.
The base rate puts those numbers in proportion. If a club could keep only 20 of these 117 players and chose at random, it would expect about 20 × 20/117 ≈ 3.4 future professionals among them; a perfect method would keep all 20. Every real method sits somewhere in between, and even the best combination in the study did not reach perfect discrimination. For why a good process still produces bad outcomes, understanding probability in sports simulations makes the same point about seasons.
The mistakes nobody sees
Johnston and Baker's review of selection decisions describes them as sometimes inaccurate, bias-driven and even illogical, and uses the term talent wastage for the cost of wrongly selecting or wrongly releasing an athlete. Their framing borrows sensitivity and specificity: how often selectors keep the athletes who would have succeeded, and how often they correctly release the ones who would not.
The awkward part is measurement. The authors note that it is nearly impossible to know whether the right athletes were selected or released. Part of the reason is simple: the career a released player would have had inside the programme never happens, so there is nothing to compare against. A club sees the misses it kept but rarely the ones it let go, so a selector's visible record is incomplete in a way that tends to flatter it.
Reading ratings on a draft board
24-0 Rugby Draft Pro League builds its board from a pool of more than 1,000 real players' careers, forwards, backs, specialists and goal kickers from different eras, and the app is explicit that its ratings and salaries are unofficial estimates. In other words, every number on its board is a scouting report rather than a measurement. The pool rotates, and position fit, value and depth matter as much as raw rating, so the research above translates into a handful of habits:
- Read a rating as a projection with a margin. Two players a few points apart may be indistinguishable once you allow for the error in the estimate.
- Buy certainty where a miss hurts most. A squad that cannot absorb one wrong evaluation, or one injury, will not survive a 24-match season under a $200M in-game salary cap.
- Tier, then choose. Group players you would be equally happy with, then decide between them on fit. What makes a good draft board sets out how.
- Value what the number cannot see. In Pro Football GM Club Soccer, position fit, playing style and squad balance all feed the result, so the highest-rated XI is not automatically the best one.
Two related pieces cover the edges of this: why a draft pool rotates explains why the board cannot be memorised, and what happens at a scouting combine looks at how physical testing influences decisions more than it forecasts careers. In both games the ratings are the games' own estimates and the simulated results are outcomes of their rules, not predictions about any real player.
More rules and research for each sport sit on our sports hub, and the draft and management games are listed under sports GM.
Good to know
Frequently asked questions
How does scouting work in sports?
What do scouts look for in young players?
How accurate is talent identification?
Are coaches or fitness tests better at spotting talent?
What is talent wastage?
Sources
- Talent Identification in Sport: A Systematic Review (Johnston, Wattie, Schorer and Baker, Sports Medicine, 2018) — PubMed abstract (opens in a new tab)US National Library of Medicine (PubMed via NCBI E-utilities) — accessed
- Evolution of soccer talent identification criteria: a systematic review from global perspectives (1976–2024) (opens in a new tab)Frontiers in Psychology — accessed
- Talent identification and recruitment in youth soccer: Recruiter's perceptions of the key attributes for player recruitment (opens in a new tab)PLOS ONE — accessed
- Selection, de-selection and progression in German football talent promotion (Güllich, European Journal of Sport Science, 2014) — PubMed abstract (opens in a new tab)US National Library of Medicine (PubMed via NCBI E-utilities) — accessed
- A Multidisciplinary Investigation into the Talent Development Processes at an English Football Academy: A Machine Learning Approach (Kelly et al., Sports, 2022) (opens in a new tab)PubMed Central — accessed
- Science or Coaches' Eye? – Both! Beneficial Collaboration of Multidimensional Measurements and Coach Assessments for Efficient Talent Selection in Elite Youth Football (opens in a new tab)Journal of Sports Science and Medicine — accessed
- Waste Reduction Strategies: Factors Affecting Talent Wastage and the Efficacy of Talent Selection in Sport (opens in a new tab)Frontiers in Psychology — accessed
League, team and athlete names appear here only to identify the rules, records and history being discussed. Reign Creative LLC's sports games are not affiliated with, endorsed by or licensed by any league, team, players' association or athlete, and all names and marks belong to their owners.
About the author
Reign Creative LLC — The independent app studio that builds the apps covered on this site and publishes every article here. On Google Play it publishes as Reign Collective Apps.
We use AI tools to help research, draft and edit our articles. Each article lists the sources its factual claims rely on, and details about our apps come from their live Google Play listings. No article on this site has been reviewed by an independent expert unless the reviewer is named on it.
No person at Reign Creative LLC has read this article in full. It was published after automated checks and an AI editorial review, which are described in our editorial policy and are not the same as a person reading every sentence.
Spotted an error? Tell us — how corrections are handled is set out in our editorial policy.