Minor League Ball: An SB Nation Community

Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Around SBN: Headlines: BC Beats BU 4-3 in 58th Beanpot Championship

The Theory and Practice of Baseball Prospect Analysis

Criswell_medium 

The Theory and Practice of Baseball Prospect Analysis

I’ve been analyzing baseball players for 31 years now. I first started doing this when I was ten years old, watching lots of minor league games with my dad in Des Moines. I adopted more objective metrics as I discovered Bill James’ work in the early 1980s. It was a hobby at first obviously, but with increasing seriousness. In college I probably spent more time studying baseball prospects than I did studying history. This was certainly true once I got to grad school and found baseball more enticing than the social development of 19th century Belgian weavers. Eventually, through a series of improbable circumstances, baseball prospect analysis became my career, and I’ve been doing it full-time for twelve years now. Here are some general thoughts.

 **Human beings are a natural system, and in one sense predicting what players will do is like predicting the weather. There are certain things you can quantify, and with enough data you can get a pretty good idea of how a player will turn out. I call this concept Spaghetti Baseball, as explained in the linked post from four years ago. But even with the most sophisticated metrics, there is still X-factors that can’t be quantified. These are things like simple good or bad luck, injuries, and what traditional baseball people call “intangibles.”  To continue the meteorological parallel, a good weatherman doesn’t just accept what the computer models tell him. He looks at all the model outputs, then comes up with his own forecast, often based on a blending of the models, but also using his own judgment and, yes, intuition. Good prospect analysis works the same way, and for that reason it is important to listen to a variety of sources. Baseball America, Keith Law, Kevin Goldstein, myself…we all have slightly different takes on the same data.

 **You have to check your ego at the door. No matter how hard you try, you will always be wrong about some players, and you will get plenty of emails telling you that. You can study and improve your methods, and indeed I find it very important to go back and review past grades and look for patterns of both success and failure. You have to be willing to accept criticism as well as praise, and to put both in their proper context.

 **Be willing to take risks. Be willing to admit when you’re wrong. When you are right, don’t rub it in people’s faces, but don’t downplay it either….let the facts speak for themselves.

 **Be aware of Groupthink. It is easy to go along with the crowd, too easy sometimes. If your instincts are telling you that a particular player is over-rated, or under-rated, by others, listen to your instincts and see if there is something empirical to back it up. Sometimes “instincts” are just brain farts, but sometimes they are a form of sub or semi-conscious pattern recognition. And even if you can’t find something empirical to back up your instinct, don’t necessarily disregard the instinct. . .

 **Know your enemy and know yourself and you can fight a hundred battles without disaster”—Sun Tzu. Be aware of your own strengths and weaknesses….strive to increase your strengths, and remedy your weaknesses. My greatest weakness as an analyst is keeping a player’s grade too high if I like him initially but if he starts to slip, Eric Hurley being a good example. I think my greatest strength is spotting sleepers early in their career before they are on many other radars.

 **Good prospecting is both a science and an art, both empirical/rational and creative/intuitive. This is especially true if you are writer and analyst, not a journalist. I think there are two main differences between my book and Baseball America’s book. Mine is more numbers-oriented, though it certainly doesn’t ignore scouting. Theirs is more scouting and team-provided-information oriented, but with some numbers, too. The BA book is an amalgam of different contributors, but mine is from a single voice and specific point of view. Theirs is more journalistic in terms of writing, more of a reporter approach, but mine is more conversational and, I think, creative. Certainly my format gives more opportunity for creative use of analogy, humorous asides and references, and comparative and historical analysis. I think this reflects the fact that I was trained as an historian, not a journalist. I love BA’s book, but there is room for both of us on your bookshelf, since our approaches differ.

 **Finally, when you do this as long as I have, you become increasingly aware of what you don’t know. There is no shame in that.

1 recs  |  Comment 13 comments

Story-email Email Printer Print

Comments

Display:

This sounds like the theory and practice of history too

Or a certain branch of history research, anyway, that loathes political science (as I do)

TheSouthWing.com - A Magazine of essays, prose and poems

by OldProspects on Jan 28, 2009 2:49 PM EST reply actions   0 recs

Methodology question

John, there is a prevailing opinion among the masses that those who examine baseball stats beyond BA, HR, RBI’s, SB’s, etc. don’t actually watch games. In other words, the prevailing opinion among many is that if a guy pays attention to any stats beyond the obvious ones, he somehow is incapable of actually watching and analyzing the game as it is played on the field.

My question is, how much would you say you use your own observation, the observation of other scouts and statistical analysis?

by sharksrog on Jan 28, 2009 4:14 PM EST reply actions   0 recs

observation

I PREFER to see players in person of course, but i live in Kansas, 200 miles from the nearest minor league team, and my travel budget is small. I get around the Midwest, Texas, and PCL Leagues and to the Arizona Fall League every year, and I watch a lot of minor league and college games on TV and internet. So it really kind of depends…some players I’m judging based on stats and reports from others, some I’m judging based on personal observation as well as stats and reports of others.

by John Sickels on Jan 28, 2009 4:40 PM EST up reply actions   0 recs

I like watching them in person too

The best player I saw last year was Matt Wieters. He was better than Bruce and Snider in person. Bruce, I saw his flaw that was going to get him exposed in the majors after his fast start, and that was the low and inside breaking pitch. Snider couldn’t hit a curve that well and fanned on one out of the zone and looked sloppy in left field. Wieters called an amazing game for Jason Berkin when I saw him in August, and while Wieters only went one for four he didn’t look overmatched at the plate.

by Bravesin07 on Jan 28, 2009 10:11 PM EST up reply actions   0 recs

Baseball, not players

John, when you watch a game, do you ever let yourself just enjoy it? A friend who works for MLB told me, when I mentioned how lucky they are, that the worst thing to do if you love something is get a job in that field, because it makes it a job.

Is analyzing players your favorite part of baseball? If not, can you just watch a game, and try to out think the managers, try to figure what strategy they employ? Do you ever get to watch and second-guess a decision to steal?

My question is, do you still get to just love THE GAME? I love individual players, but it is the game that I love the most.

by drwmsu1 on Jan 29, 2009 3:59 PM EST up reply actions   0 recs

I haven't been reading reading you...

for too long but I must say how happy I am to find out you are a fellow Des Moinesian (that’s how we say it, right? Haven’t lived in Des Moines that long). Whether you are a current or former resident, thanks for all you do.

by IA Card on Jan 28, 2009 4:16 PM EST reply actions   0 recs

IA

I grew up in Des Moines, went to college at Northwest Missouri State in Maryville, then went to grad school at KU in Lawrence where I currently live.

by John Sickels on Jan 28, 2009 4:41 PM EST up reply actions   0 recs

Bill James

should be in the Hall of Fame.

by richieabernathy on Jan 28, 2009 5:23 PM EST reply actions   0 recs

Instincts

 Sometimes you here a name and for some reason your instincts kick in to not like him. I like to study the players i don’t like or my instincts turn me away from harder and more in depth. This gives me a good balance of the numbers and the instincts side. But in the end if you fight your gut and go with the numbers you take out your personality and that is what makes league’s and articles fun. There is no regret like having a choice and choosing wrong based on numbers or the influence of others. Use your tools as a human and have fun.

by svigen on Jan 28, 2009 5:53 PM EST reply actions   0 recs

The proper blend
He looks at all the model outputs, then comes up with his own forecast, often based on a blending of the models, but also using his own judgment and, yes, intuition.

That is about as precise a definition of what a prospect analyst should do as I have ever seen.

Mike Emeigh http://www.baseballthinkfactory.org/files/minor_key/

by MikeE on Jan 29, 2009 1:18 PM EST reply actions   0 recs

Criswell...

… responsible for the great quote (from Plan 9 From Outer Space), “future events such as these will affect you in the future.”

and boom goes the dynamite.

by Mean Dean on Jan 29, 2009 10:32 PM EST reply actions   0 recs

Comments For This Post Are Closed


User Tools

Minor League Ball: Where the Future of Baseball is Discussed
Start posting on Minor League Ball »

Join SB Nation and dive into communities focused on all your favorite teams.

FanPosts

Community blog posts and discussion.

Recommended FanPosts

Small
Community Prospect #52
Small
Community Prospect #51
Small
Community Prospect #50
Small
PP Top 50
Small
Top 10 according to me

Recent FanPosts

Jed_bird_small
2010 Top 75 NL Prospects
Small
Derek Holland
Small
Minor League Chat
Small
Montero vs Jennings vs Heyward
Background_small
Draft Preview - Cleveland Indians
Small
Looking for 2 Dynasty League Managers
Small
Looking for Dynasty fantasy owner
Small
Dynasty trade offer
Small
Grichuk or Heathcott

+ New FanPost All FanPosts >


Managers

Carew_small John Sickels


Site Meter