AI Expert Audit: LeBron vs Michael Jordan

A. Your Source Material

  • What document(s) did you use?
  • Why are you an expert in this content?
  • What makes this material important or meaningful to you?

I utilized two documents that I felt would give the AI a well-rounded and robust overview of the topic. I first gave the AI an article that simply showcases side by side statistical comparisons. This covered the objective and mathematical portion of the debate. I then gave AI a link to the most popular reddit thread on this topic, so it can have access to the more subjective side where oddly specific details were discussed to a greater extent. Every possible argument people made, the AI had access to now. What makes me an expert in this content is the fact that I’ve been talking about it and posing the question for years now even writing a paper on it in high school which I eventually switched stances from. I’ve done the research and due diligence. This material is meaningful to me because the game of basketball happens to be my favorite sport and I believe it is human nature to want to recognize the absolute pinnacle of any sporting event or endeavor. At least it’s in my nature. 

B. The AI-Generated Materials

  • Embed or link to the podcast, mind map, and infographic NotebookLM created
  • (You can screenshot the mind map and infographic, or describe them if embedding isn’t possible)
  • MindMap
  • Podcast  
  • Report 

C. Your Expert Audit

Respond to ALL of the following:

1. Accuracy Check

  • What did the AI get right?
    • The AI got a lot right in this analysis. It correctly noted that not all opponents are created equal, and that a ring isn’t just a ring, since MJ never had to face a team like the 73-9 Warriors that LeBron did. It also recognized that the modern NBA is a fundamentally different and harder game, with greater talent depth and ball knowledge across the league. The AI did a solid job tracing LeBron’s different team phases as he moved around, compared to Jordan’s primarily Bulls-centric career, and it accurately pointed out that MJ never lost a Finals series when he was favored, unlike LeBron’s losses in critical series like the one against the Mavericks. It also picked up on how offensive and defensive strategies have evolved, along with physical factors like court conditions. One of its stronger points was recognizing that you can’t just teleport a player into a different era without accounting for the transfer of era-specific knowledge and resources, showing genuinely good era recognition. It also acknowledged that differing definitions of greatness mean this debate will likely never be fully settled, and overall it compared accolades between the two players well. 
  • What did it get wrong, oversimplify, or miss entirely?
    • On the other hand, there were some notable shortcomings. The AI oversimplified LeBron’s longevity by framing it as an unanswerable marathon-versus-sprint comparison, when in reality his extra seasons should have been treated as a real, substantive point of comparison rather than dismissed. It also spent too much time diving into the players’ business footprints and finances, effectively defining their value too heavily around how good a financial asset each of them is rather than their on-court impact. It missed their physical attributes entirely, failing to mention that LeBron is the bigger player while MJ had the higher vertical. And it leaned too much on points per game without giving enough attention to shooting percentages, which left an important efficiency dimension of the comparison underexplored. 
  • Were there any subtle distortions or misrepresentations that a non-expert might not catch?
    • Not that I noted, what the AI spoke on seemed to be accurate. 

2. Usefulness for Learning

  • If you were encountering this material for the first time, would these AI-generated resources help you understand it?
  • What do the podcast, mind map, and infographic each do well (or poorly) as learning tools?
  • Which format was most/least effective? Why?

If I were encountering this material for the first time, the AI-generated resources would definitely help me understand it. The podcast did really well at exploring specific arguments like era-specific differences, but spent a lot of time on a few when I think spending less time on more arguments would’ve been more all encompassing. The mind map laid out all of the data in a really neat and organized way only coming short when it came to oversimplifications. For example in the cumulative totals nodes, only three stat lines are presented. The report was an all around great document of information that dove the deepest into statistical comparisons. 

3. The Aesthetic of AI

  • What “AI weirdness” did you notice? (Strange phrasings, generic language, odd emphases, uncanny tone, oversimplifications, etc.)
  • Did the AI have a particular “voice” or style? How would you describe it?
  • What does the AI prioritize or emphasize that a human expert might not?

Some AI weirdness I noticed was at times in the podcast it almost seemed to crash and freeze for a few seconds. Leaving us with a creepy long stutter. The AI didn’t really have a particular voice or style because the three different sources it generated all came at the debate from different angles. I don’t think in the context of the topic I chose the AI emphasized a specific point that I couldn’t see a human expert emphasizing. Although it was partially based on a reddit thread so it’s almost echoing human thought.

4. Trust & Limitations

  • Based on this experiment, what would you warn someone about trusting AI-generated educational materials?
  • Where does AI seem most reliable? Where is it most likely to mislead?

I would say to use AI as a general overview offering the comfort to trust the salient points. It seems the most reliable in covering the big arguments and doing so in a fully cohesive way. Where I would caution someone is about the finer details. It seems AI can oversimply or overlook them in an effort for a more efficient conclusion/explanation. In my experience though AI didn’t necessarily state any incorrect information.