Federal Baseball: An SB Nation Community

Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
Network Message: 50% Off: CBS/SB Nation Fantasy Baseball

Nats Stats: Who lost the W.A.R.?

Those of you paying attention in the off-season may recall the FederalBaseball.com W.A.R. Effort, an attempt to project out the Nationals' 2009 record using Wins Above Replacement (W.A.R.) calculations.  We argued about lineups and playing time, looked at projections for hitters and pitchers, then plugged it into a big spreadsheet.  The answer we got was that the Nats should manage around 75 wins in 2009, with a 99% chance of getting 61 or more wins.  As we're now on a pace for 50ish wins, it seems that we were wrong.  Quite wrong. Exceptionally, overwhelmingly, soul-ravagingly wrong.  How did we miss so wildly?

After the jump, we'll take a look at what we got wrong (bullpen, fielding), what we got right (almost nothing), and what still doesn't make any sense (the Nats are worse than my math can calculate).  Remember to show your work for partial credit!

Star-divide

But first, a quick aside...

Let me outline the idea behind W.A.R. The basic concept of "replacement level" is a player who's freely available on the waiver wire or from AAA--someone a team can pick up on the cheap to replace an injured starter.  There's some debate in the stat community about exactly what replacement level means, but figure that a team made up of "replacement level" players is a AAAA team, and will win about 48 games in the NL (starting to look familiar?).  Anyhow, the idea is that you compare a player's hitting/pitching stats and playing time (or their projected stats and playing time, if you're trying to look ahead) to "replacement level" to come up with a number of extra runs scored/saved.  These runs turn into "wins above replacement" (or "below" replacement for some... I'm looking at you, Daniel Cabrera!).  Add up the total W.A.R. for everyone on the team with the baseline wins for a replacement-level team, and you get the wins on the season.  Of course, this is an average number, and the number of wins will probably be higher or lower by some amount.

Are we talking about the same team?

Back in the final W.A.R. update, I had a projection of 76.9 wins on average.  Even I was a little suspicious over whether we could pull that off, but I figured we were a lock for at least 70.  Adding up the projected playing time, plus projections for hitting, pitching, and fielding, I figured we were looking at a total of 28.4 Wins Above Replacement.  Of those, 19.8 WAR came from the position players, almost all from hitting (I had us losing about 0.1 WAR from fielding, and gaining something like 0.05 WAR from baserunning).  The other 8.6 WAR came from the pitchers, with 6.5 from the starters and 2.1 from the relievers.

We can check out our current WAR values at a stat site like fangraphs, which calculates WAR (it's a counting stat) as the season goes along, based on playing time, hitting, fielding, and pitching.  As of July 13, our position players have generated a total of 8.7 WAR, 12.0 from batting and -3.3 from fielding.  Compare to my projection of 10.6 WAR after 87 games, all from hitting: we're actually hitting almost 1.5 wins better than I'd projected, but our fielding is more than 3 wins worse!  That puts us almost 2 wins off of the projected pace already.  As for the pitching...  Well, so far we only have 3.2 WAR from pitching, 4.0 from the starters and -0.7 from the bullpen.  I was projecting 4.6 WAR from pitching at this point (split about 75-25 between rotation and pen), so there's another 1.5 wins gone!  Even so, that puts us at 11.9 WAR (versus my prediction of 15.3 after 87 games).  That's 38 wins after 87 games.  The Nats have 26.

What's going on, here?  We already know that the Nats' "Pythagorean" record has them at 33 wins, so they're already at least 7 games' worth of unlucky.  WAR is also a calculation of average number of wins.  You'd expect to be above or below that number most of the time.  In fact, if our inputs to the WAR spreadsheet were right, we'd expect a record of between 66 and 81 wins 90% of the time (10% it would be either more than 81 or less than 66)--call it plus or minus 8 wins, which would be plus-or-minus 4 wins after 87 games.  But even the Pythagorean 33 wins is just outside that 90% confidence interval with 38 wins from WAR.  The Nats are either unlucky to a statistically-unlikely degree, or they stink in some way that Wins Above Replacement can't model.  I don't know what the answer is, but it seems to me that both factors probably play a role (WAR calculations are an inexact science at best, and who's more snakebitten than the Nats?).

Did you get anything right?

Who, me?  The guy who predicted 450-500 PA for Jesus Flores, Elijah Dukes and Lastings Milledge?  I'm amazed I got as close as I did.  Happily, several Nats did much better than I predicted:

  • Even injured, Jesus Flores has been worth 1.0 WAR in limited playing time--I had him at 0.4 WAR over the season.  Moral?  Have a season-ending injury while your bat is hot!
  • Zimm the Elder is worth his moneys.  His hot bat and hotter glove are worth 3.2 WAR so far this season (ahead of my projection of 2.6 at this point).
  • Willingham has been a pleasant surprise: his 2.2 WAR is second only to RZim thanks to a hot bat and league-average glove (I had him at +1.0 WAR on the season with limited playing time).
  • NJ is about the only thing I've gotten right, with 1.5 WAR so far against my projected 1.6 (his fielding slightly worse this season than I projected).
  • Zimm the Younger's +1.7 WAR in a half a season is as good or better than I was projecting for any starter over the whole season.  Stammen's +1.0 ain't bad, either.  Lannan's +0.7 is off the pace (+0.9) I had for him.

Sadly (but predictably), many Nats did worse:

  • Dunn is not like a box of chocolates: +2.9 WAR with the bat, -2.2 WAR with the glove...
  • How did I ever believe Cabrera would be worth 1.7 WAR over the season? Instead, he's cost the Nats -0.4 in limited playing time.
  • Elijah Dukes was another disappointment: -0.5 WAR in limited playing time, when I was quite rationally calling for +2.5 over the season.
  • Beimel is best in the bullpen at +0.1 WAR...  everyone else is replacement-level or worse.  But you knew that.

What have we learned?

Aside from, "don't go to Vegas with Doghouse"?  I think we may be running into limitations of the WAR approach: it may work best for a team this isn't too bad in any one area.  You can assign a win value to each part of the club and add 'em up.  But if you have a team with, say, really bad defense and a really bad bullpen, it may have a disproportionately bad effect on the number of wins.  You can't just add up the bullpen, rotation, and hitters anymore--some awful synergy takes over and applies the '62 Mets Factor to all of your results.  In short, it seems that the badness of the 2009 Nats defies mathematical analysis!

I'll revisit this at the end of the season when we have full-year performance and playing time, and see if the WAR calculations hold up any better then.

0 recs  |  Comment 12 comments |

Story-email Email Printer Print

Comments

Display:

good work

The 2009 Washington Nationals: Mathmatical Analysis Defying Badness!

Your voice of doom and gloom. Read more at natsnewsnetwork.blogspot.com

by Dave at Nats News Network on Jul 14, 2009 6:14 PM EDT reply actions   0 recs

Interesting article, very cool! It’s good to know that even math couldn’t have predicted the bad season the Nationals are having.

by John Quinn on Jul 14, 2009 6:58 PM EDT reply actions   0 recs

Underestimating fielding and the bullpen was more or less what killed it.

No one player has really underperformed; I’d argue we should’ve seen Dunn’s god-awful defense coming, but I’ve been surprised that Willingham has picked it up in the field. Luck has played a huge part in it, though; this team is bad but it’s not this bad. The management, on the other hand….. Well, I’ll save that rant for after the signing deadline passes. (E, I want the front page if that happens.)

My suspicion with Pythag is that it comes apart at the margins, and the Nats blown save percentage is nothing but if not at the margins; a bad bullpen doesn’t reflect enough in Pythag.as it ….well, should is the wrong word, but it doesn’t reflect enough in Pythag. On top of that, I suspect that it understates defense a bit (pitching and batting are known, “easily” quantifiable entities), and while normally that wouldn’t be a big issue, remember we’re at the margins here. Baserunning also plays no part in your WAR calcs; I wouldn’t be surprised if that cost another win effectively.

Without going into too much detail, I’d love to see how the Nats have performed relative to situational run expectancy (i.e., bases-loaded, no-outs situations result in an average of 2.2 runs to the end of inning; how did the Nats do?). I think that’s where it falls apart; the Nats possibly have tanked there. I’m not sure we could determine that by total win expectancy change (since that’s a defined quantity per game). Sub-average results across the board – or even in certain key situations – could be the “key”, as it were.

by Graysnail on Jul 14, 2009 6:59 PM EDT reply actions   0 recs

I did have a factor for baserunning in my "projected" WAR calculations...

…although it was based purely on steals, and ended up being on the order of 0.1 WAR for people who were “fast.” The “actual” WAR numbers I pulled from fangraphs are based purely on wOBA, I think, and don’t account for baserunning (although I may have that wrong). So far we have 36 SB and 18 CS on the season, which roughly cancel each other out for +0 WAR. I’m not savvy enough to pull together the calculations for getting Tolmaned and the like.

I agree that Pythag and WAR probably both break down extreme cases, and the Nats are certainly extreme… I tried to do a WAR “projection” of last season with the actual stats a while back (see here), and the “predicted” wins were 63, compared to 59 actual and 62 Pythag. Of course, this year’s Nats are looking like even more of an extreme case than last year’s.

Comparing actual results to situational run expectancy would fun—I’ll do a post on that soon.

"It's not a secret, you don't need to be an expert on math to know that walks plus errors equals runs...." --Mannyger Acta

by Doghouse on Jul 14, 2009 7:38 PM EDT up reply actions   0 recs

I wasn't necessarily meaning steals.

I was thinking the Nats’ ability to screw themselves over on the basepaths. I don’t know if that’s reflected anywhere (IIRC, wOBA doesn’t account for that). I don’t know if that’s what you meant by Tolmaned.

by Graysnail on Jul 14, 2009 8:07 PM EDT up reply actions   0 recs

Yeah, running into outs, shrinking doubles into singles, getting thrown out at the plate... (TOLMAN!!)

I don’t know if there’s a stat that captures that, either. I don’t know of any.

"It's not a secret, you don't need to be an expert on math to know that walks plus errors equals runs...." --Mannyger Acta

by Doghouse on Jul 14, 2009 10:09 PM EDT up reply actions   0 recs

You forgot

getting picked off, missing 2B (while running bases), balks, and WP…

Got to lift your stats game Doghouse.

Im calling for the ‘suck’ index.

"Baseball is like church. Many attend; few understand."

by Mezza on Jul 14, 2009 11:20 PM EDT up reply actions   0 recs

so the whole is worse than the sum of the parts?

it will be interesting to see how the second half goes and if Riggleman can get the errors
down. We have some players with ability that should be playing better, like Gonzo and Andy. I have really become a Hammer fan and expect him to continue hitting well. He used to kill us when he was with the Fish. Zimmy needs to get those errant throws out of his system. And most importantly, they’ve got to hit with RISP. How many times this year have they failed to score people when the bases have been loaded? We won’t even mention the bullpen. 20 blown saves, No wonder the math can’t add up right.

by gengreen17 on Jul 14, 2009 7:00 PM EDT reply actions   0 recs

there's no reason to believe Riggleman will have any impact on this team's fielding skills

other than threatening playing time for players that are perceived to be dogging it, what could Riggleman possibly do to make the fielding better?

and for threatening playing time, who can you that to? Dunn? Johnson? Zimmerman? Guzman? i suppose you could put Guzman on notice, and possibly bench him — but then forget completely about trading him. you can trade a lousy every-day player, but not one benched for lackadaisical defensive play.

Your voice of doom and gloom. Read more at natsnewsnetwork.blogspot.com

by Dave at Nats News Network on Jul 14, 2009 8:46 PM EDT up reply actions   0 recs

I want Riggleman

To act like Lou Brown…and dish out push ups to anyone who boots a ball.

"Baseball is like church. Many attend; few understand."

by Mezza on Jul 14, 2009 11:21 PM EDT up reply actions   0 recs

Aren't runs saved better than runs scored for wins

and therefore runs failed to be saved being worse than runs not scored? Ie a bad defense will hurt you more than a bad offense, and a good defense will help more than a good offense. I believe I have read this. So if you take this to extreme, a terrible defense will hurt proportionally more than a mearly bad one toward wins. What I am trying to say is the breakdown in the predictors comes from our defense being so extremely bad. Ten runs lost to defense usually counts as one game lost whereas 100 runs lost by a defense will count more like 15 games lost (I am not saying we are -100 runs just showing scale). Since the Pythag and WAR are based on the 10 runs being a win they are scaled wrong for our level of badness defensively. That is my guess anyway.

"What you know is often the enemy of what you can learn" Bill James

by PhDBrian on Jul 16, 2009 10:12 PM EDT reply actions   0 recs

Comments For This Post Are Closed


User Tools

Welcome to the SB Nation's blog about the Washington Nationals. Federalbaseball.com Trying To Make Every Fan A Nationals' Fan.
Start posting about the Nationals »

Join SB Nation and dive into communities focused on all your favorite teams.

Connect_with_facebook

Cbs_fantasy_baseball_promo

FanPosts

Community blog posts and discussion.

Recent FanPosts

Small
Bullpen Banter's Nationals Preview and Top 25 Prospects
Brian3_small
Desmond at SS everyday
12475953_small
2010 NL East Fan Projections: SPs
Sw_small
Call me crazy
Small
Larry Stone on Riggleman and McLaren
Small
Strasburg Featured on ESPN MLB Front Page
Small
Nationals stock rising; just not buying quite yet
Small
Hot Stove keeps me all warm and fuzzy inside
Ice-cube_small
First Annual Federal Baseball Fantasy Baseball League!
Small
Buccos Dugout/Federal Baseball Fantasy Baseball League

+ New FanPost All FanPosts >

GAMETHREAD SPONSOR

Masn_medium


Ministry of Peace

V-3_small Ed Chigliak

Ministry of Truth: Records Department (Editor)

Ws1_small Winston Smith

Ministry of Plenty

Teddy_small Doghouse

Daveslogo5_small Dave at Nats News Network

Youppi_040618_mon_a_small bluelineswinger

Ice-cube_small John Quinn

Natsscoreboard_small natsstats