# Why Reps and Managers Grade the Same Call Differently Author: Thuy Tran Author URL: https://blog.thelearningos.com/author/thuy-tran Published: 2026-11-04 Category: Learning Category URL: https://blog.thelearningos.com/category/learning Meta Title: Skills Quotient AI Balances Rep vs Manager Call Scores Meta Description: Reps and managers grade the same sales call differently. See why self-ratings fail as a skill quotient and what to score instead. Book a free demo today. Tags: AI/, sales-training/, SkillQuotient Tag URLs: AI/ (https://blog.thelearningos.com/tag/ai), sales-training/ (https://blog.thelearningos.com/tag/sales-training), SkillQuotient (https://blog.thelearningos.com/tag/skillquotient) URL: https://blog.thelearningos.com/skill-quotient-self-rating-vs-manager-rating ![Sales coaching challenge managers and reps evaluation discrepancy - LearningOS](https://prod.superblogcdn.com/site_cuid_clbaherx5941821ml5d9gt506f/images/article-5hero-1793775487909-compressed.png) A rep finishes a call convinced it deserves an 8. The manager listens to the recording later and gives it a 5. With no evidence on the table, the argument over the rep's [**skill quotient**](https://www.thelearningos.com/skill-quotient-ai) gets settled by seniority. Both scores feel fair. Neither is a measurement. Here is why they differ, and what to score instead. ## **Can Reps Accurately Rate Their Own Sales Calls?** Only partly. Research on salespeople finds that self-ratings and manager ratings agree only weakly _(_ [_Jaramillo, Carrillat and Locander_](https://www.tandfonline.com/doi/abs/10.1080/08853134.2003.10749010) _)_. Self-ratings still carry real signals about results, so they are useful input. Treat them as testimony, not evidence. The rep isn't lying. The rep is remembering. The weak agreement is not a sales quirk. A meta-analysis of more than 37,000 employees found the same thing across jobs: what people say about themselves and what supervisors say about them overlap far less than anyone assumes _(_ [_Heidemeier and Moser_](https://kris.kl.ac.at/en/publications/self-other-agreement-in-job-performance-ratings-a-meta-analytic-t/) _)_. The reason is simple. The rep and the manager are not looking at the same thing. Picture the Monday review. The rep remembers the objection they handled well. The manager remembers the pricing question that got a shrug. Both memories are fair. Neither is a recording. ![Skills Quotient AI efficiently gives a comprehensive breakdown of past calls for customer facing teams](https://prod.superblogcdn.com/site_cuid_clbaherx5941821ml5d9gt506f/images/article-5image-1-1793775530912-compressed.png) ## **How Does Self-Rating Skew a Skill Quotient?** Self-ratings skew in both directions. In a study of salespeople, bottom performers overestimated their results, top performers underestimated theirs, and the weaker group was also the less accurate one _(_ [_Jaramillo, Carrillat and Locander_](https://www.tandfonline.com/doi/abs/10.1080/08853134.2003.10749010) _)_. A self-rated skill quotient therefore tends to flatter the weakest reps and shortchange the strongest. The extreme cases are easy to spot. In a Zenger Folkman dataset of individual contributors, roughly 1 in 25 ranked themselves in the top quartile while their manager ranked them in the bottom quartile _(_ [_Zenger Folkman_](https://zengerfolkman.com/articles/what-your-manager-sees-that-you-dont/) _)_. The sample spans roles rather than sales alone, but the direction of the gap matches. Across Western samples, self-ratings also ran higher than supervisor ratings on average _(_ [_Heidemeier and Moser_](https://kris.kl.ac.at/en/publications/self-other-agreement-in-job-performance-ratings-a-meta-analytic-t/) _)_. Confidence is a feeling. A skill quotient needs a measurement. **_Read more_** **>>\>** [**_Why Skill Gaps in Sales Training Surface as Lost Deals_**](https://blog.thelearningos.com/sales-training-skill-gaps-lost-deals) **>>>** [**_IQ, EQ, and SQ: Skill Quotient as the New Workforce Metric_**](https://blog.thelearningos.com/iq-eq-sq-skill-quotient-workforce-metric) **_See LearningOS in action:_** [**_schedule your free demo_**](https://www.thelearningos.com/book-intro) **_and find out how your team can train smarter, not harder._** ## **What Is a Skill Quotient? Three Ways to Grade One Call** A skill quotient (SQ) is a measurable score of how well someone performs a specific skill, based on evidence of what they actually do. In sales, that evidence is the call. (This is the workplace SQ, not the social or spiritual one.) A trustworthy [**skill quotient**](https://www.thelearningos.com/skill-quotient-ai) compares three things: what the rep says happened, what the manager thinks happened, and what the call shows happened. Only the third can settle an argument. ![Sales reps and managers are biased when scoring calls but AI analysis is objective - Skills Quotient AI](https://prod.superblogcdn.com/site_cuid_clbaherx5941821ml5d9gt506f/images/article-5image-2-1793775568221-compressed.png) Managers are not a clean benchmark either. In research co-authored by Harvard's Iris Bohnet at a multinational, manager ratings tracked employee self-ratings closely when managers read them first _(_ [_Harvard Gazette_](https://news.harvard.edu/gazette/story/2025/12/why-self-appraisals-may-not-be-best-way-to-judge-job-performance/) _)_. In the one year managers could not see them, the link weakened. A skill quotient built on both is still mostly opinion. ## **Where Do Researchers Disagree About Self-Ratings?** Researchers split on which rating is more accurate. A 2004 comment challenged the finding that self-reports are less accurate than manager ratings _(_ [_Sharma, Rich and Levy_](https://www.tandfonline.com/doi/abs/10.1080/08853134.2004.10749025) _)_. The defensible summary is narrower: the two barely agree, and neither is evidence. Self-reports are not worthless, either. They tracked objective results, though less closely than manager ratings did _(_ [_Jaramillo, Carrillat and Locander_](https://www.tandfonline.com/doi/abs/10.1080/08853134.2003.10749010) _)_. The kind of indicator also mattered: nonjudgmental performance indicators were among the main factors shaping how closely the two ratings agreed _(_ [_Heidemeier and Moser_](https://kris.kl.ac.at/en/publications/self-other-agreement-in-job-performance-ratings-a-meta-analytic-t/) _)_. Asking for facts instead of feelings is the first step toward call evidence. Either way, a skill quotient needs something firmer than either rating. ## **What Does Effective Sales Training Score Instead?** Effective sales training scores the call, not the memory of it. Skills Quotient AI grades every customer call against your own sales playbook, down to the exact moment that mattered. Each skill gets a score out of ten and a target, so the rep and the manager look at the same number. Self-ratings can also skew the training itself. A rep who underrates a strong skill may be coached on it anyway. One who overrates a weak skill may be waved through. Three changes are worth starting with: - Score the call before anyone shares an opinion - Ask fact-based questions instead of "how did it go?" - Track one skill quotient score per skill, not one verdict per rep For sales managers and enablement teams tired of settling call debates by seniority, the fix is a score that comes from the call itself. ## **Why Does a Capability LMS Need Call Evidence?** A [**capability LMS**](https://www.thelearningos.com/platform/what-is-learning-os) tracks skills rather than course completions. Completions show who sat through the training. Skills show who can sell. In Skills Quotient AI, real calls, roleplays and courses feed one view, so a skill quotient reflects what the rep did, not what they remembered. When a rep and a manager still disagree, Ask SQ settles it with the same call that produced the score. It lives inside every scored call record. Ask "Where did I slip?" and the answer comes back with timestamps for the exact moments. Averaging two opinions is a poor substitute for the recording. ## **Conclusion** Reps and managers grade the same call differently because one is grading memory and the other is grading a sample of it. Give both the same recording and the argument becomes a coaching conversation. A skill quotient built on evidence gives the rep a target and the manager a reason to stop guessing. **_Ready to see AI roleplay and assessment in action?_** [**_Book a free Skills Quotient AI demo_**](https://www.thelearningos.com/book-intro) **_and watch your team's training performance shift._** ### **About Us** At OOOLAB (pronounced "uːlæb"), our mission is to make complex learning operations simple. We aim to positively impact the lives of over 1,000,000 learners and educators by the end of 2026. OOOLAB's LearningOS provides educational institutions and corporate enterprises with an all-in-one solution to create and deliver engaging learning experiences. - Dedicated success manager - Personalized setup - Ongoing assistance **Learn more at** [**thelearningos.com**](https://www.thelearningos.com/) ## FAQs Q: What is a skill quotient in sales? A: A skill quotient (SQ) is a measurable score of how well someone performs a specific skill, based on evidence of what they actually do. In sales, it is built from calls, roleplays and courses rather than self-ratings. Skills Quotient AI gives each skill a score out of ten and a target. Q: Can reps accurately rate their own sales calls? A: Only partly. A meta-analysis found that salesperson self-ratings and manager ratings agree only weakly (Jaramillo, Carrillat and Locander). Self-ratings do track objective results, so they are useful input, but they are not a measurement. Q: Why do managers and reps grade the same call differently? A: They work from different evidence: the rep from memory, the manager from whatever portion they reviewed. Managers can also anchor on the self-score. At one multinational, manager ratings tracked employee self-ratings closely when managers saw them first (Harvard Gazette). Q: Are self-assessments reliable for finding skill gaps? A: Not on their own. Across more than 37,000 employees, self-ratings and supervisor ratings agreed only modestly (Heidemeier and Moser). Pair them with call evidence and a score per skill, and ask fact-based questions instead of opinion-based ones. Q: How do you measure skill quotient in sales without relying on opinions? A: Score every call against your own sales playbook and track a score out of ten for each skill. Skills Quotient AI does this for every customer call, then feeds calls, roleplays and courses into one view. Self-ratings and manager ratings then become context, not the measurement. --- This blog is powered by Superblog. Visit https://superblog.ai to know more. ---