Navigation: Jump to content areas:


Pro Quality. Fan Perspective.
Login-facebook
Around SBN: Randy Moss A Raven?

Marc-Andre Fleury and Save Percentage: Part I

As a relatively new Penguins fan, one of the first games I ever watched was Game 5 of the 2008 Stanley Cup Final. As I'm sure many of you remember, that was the game where Fleury shed his mortality for about two hours and stopped everything he saw in overtime, giving the Penguins a chance to win it in triple OT. At the end of that game, for better or worse, I became forever endeared to the guy we call "Flower."

This year, Fleury unfortunately wasn't able to replicate the success he had in that Game 5. He was inconsistent throughout, and he posted his lowest single-season save percentage this year. The purpose of this series of posts is to try and figure out why. To do this, I'm going examine his play and divide it into two parts: even strength save percentage and power play save percentage. To clarify, I refer to power play save percentage as Fleury's save percentage while the other team is on the power play (this is also how NHL.com reports the statistics). I'm not going to examine Fleury's performance while the Penguins were on the power play because it's a minuscule segment of his overall play.

I'll be looking at save percentage to the exclusion of GAA, wins, and shutouts because it is the best measure of a goalie's performance irrespective of the team in front. GAA is dependent on shot volume against while wins are dependent on goals scored, neither of which a goalie has any control over. Shutouts happen too infrequently to draw anything meaningful from them.

In this post, I'm going to be looking at Fleury's power play save percentage this year. To compare him to other goalies, I used the top 30 goaltenders in power play shots against this year as my sample. Analysis after the jump...

Star-divide

Fleury finished this season with an .891 power play save percentage, good for 10th in this sample. The sample average was .879 and the distribution of power play save percentages was very close to normal (or in other words, a bell curve). In terms of power play shots against, Fleury was 7th out of 30 with 340. It makes sense that Fleury would have seen so many shots against on the powerplay because the Penguins spent the 3rd most time this season (508 minutes) playing 4-on-5 hockey. 

 

While I was looking at the shots against for goalies on the power play, I realized that it might be helpful to also examine the ratio of power play shots against to even stregnth shots against. I did the math for all 30 goalies in the sample [(PP SA)÷(ES SA)] and ranked them from highest to lowest. Fleury's PP SA ratio was 24.6%. Here's some info about the stat:

 

PP SA Ratio
Mean 22.47
St. Dev. 2.89
Range 13.7
Minimum 15.8 (Brodeur)
Maximum 29.5 (Nittymaki)

 

The important thing at this point is to figure out in which context we want to analyze these numbers. We can compare the Fleury of this year to the Fleury of year's past, or we can compare the Fleury of this year to the 29 other goalies of this year in the sample. I think both contexts have merit.

I'll start by comparing Fleury against himself. Fleury posted the best power play save percentage of his career this year (.891). However, he also faced the least amount of power play shots against this year, as he saw 386 in 2005, 413 in 2006, and 361 in 2008 (he saw 184 in 2007 but he only started 35 games; it would translate to 352 in 67 games). His PP SA ratio also was the lowest of his career, as it was 37.6% in 2005, 29% in 2006, 26.9% in 2007 and 25.4% in 2008. In terms of the other goalies in the sample, Fleury's 24.6% PP SA ratio was 8th. Among goalies in the sample who played in at least 50 games, Fleury's 24.6% was 4th out of 20.

Fleury's collection of shots was one of the most difficult in the league this year because such a high percentage of them came on the power play. The average power play shot is of a higher quality than the average shot at even strength. Because of this, a goalie's power play save percentage is always considerably lower than his even strength or total save percentage. Here are the differences for the sample:

EV SV% TOT SV%
Mean Decrease .042 .034
St. Dev. .024 .019
Range .096 .08

[For example, the average goalie's pp SV% is .042 lower than his even strength SV%.]

 

As a final thought, this analysis got me thinking about how the PP SA ratio might affect a goalie's total save percentage. Goalie's who have a higher ratio would have lower total save percentages (due to the higher quality of more of their shots). The correlation coefficient for these two sets of data (PP SA ratio and TOT SV%) was r = -0.28. While the data seems to be negatively related (my initial thought), the correlation coefficient is much too weak to draw any conclusions. Shrinking the sample to goalies with 50 or more games played actually weakens the correlation. Yet after I did this, I visually realized that there were three goalies who were seriously bucking the trend: Ilya Bryzgalov, Mikka Kiprusoff, and Evgeni Nabokov. They all had high total save percentages and high PP SA ratios. Once I removed these three goalies from the sample of those who played in 50 or more games, the correlation coefficient doubled to r = -0.4. Here's a scatter plot showing the 17 data points:

 

Pp_sa_ratio_medium

[Note: While this is extremely tentative evidence, I think it's encouraging enough to trigger more research. I'm going to collect data from more seasons to see if the correlation is stronger over a bigger sample.]

 

Overall, Fleury had a very good year as far as power play save percentage is concerned. His .891 was well above the sample average even though he faced the 7th most shots against and had the 8th highest PP SA ratio. His teammates made his job much harder this year by taking all the penalties they did, and forcing Fleury to make saves in situations in which shot quality is at its peak. But Fleury performed admirably and set a career high for himself in the process. Ultimately, Fleury's power play save percentage was not the problem this year. In Part II, I'll look at Fleury's even strength save percentage and the circumstances surrounding it, and hopefully be able to provide an acceptable explanation as to what happened this year to Marc-Andre Fleury.

Comment 28 comments  |  2 recs  | 

Do you like this story?

Comments

Display:

Great post! You really know what you are writing about and have the stats to back it up. I learn quite a bit reading these posts.

Your last sentence says it all, allows the discussion to begin. I feel that without Gill/Scuderi in front of him, MAF wasn’t the same guy, the same goalie. I think he needs great shutdown D to help him out, like pieces of a puzzle.

There were comments about his finger he hurt in Vancouver but he wasn’t playing consistantly well before that happened.

Yes, his teammates made his job much harder by all the dumb penalities they took. Then some of our D hung him out to dry as G/S would not have.

A goaltender can be fantastic, but he will only go as far as the great D helping out in front of the crease.

Looking forward to your part 2

One Who Lives And Breathes All Things Penguins

by PensFanInDenver on Jun 12, 2010 11:24 AM EDT reply actions  

Thanks a lot for the compliments PFID, I really appreciate it.

I feel that without Gill/Scuderi in front of him, MAF wasn’t the same guy, the same goalie.

I agree with this statement. The one thing that kills me is that we can’t measure what I call a feedback effect. That is, Fleury knows his D in front of him isn’t as good as last year (or more generally, they’re below average). Because he knows this, he overcompensates and further depresses his save percentage by making more mistakes than he normally would. Part of Fleury’s struggles might have been a response to the guys in front. But we’ll never know for sure…

Pittsburgh sports all the way

by GoPens! on Jun 12, 2010 2:10 PM EDT up reply actions  

i feel that

getting rid of gonchar and letting any actual defenseman who plays defense will enhance MAF ability back to normal next year. i pray they dont sign gonchar for these reasons 1. his d skills suck 2. we are gonna have to see if letang and gogo can run the pp 3. hes too old and hes not lidstrom 4. salary not worth it anymore 5. his d sucks and he tanked the most important game last year and his d skills suck. if he takes a legitimate salary cut then yes keep him thats the only reason i would like him back

by Chris Schlitz on Jun 13, 2010 12:31 PM EDT up reply actions  

“I’ll be looking at save percentage to the exclusion of GAA, wins, and shutouts because it is the best measure of a goalie’s performance irrespective of the team in front.”

Not true at all. Putting up a .925 against long slappers is quite a bit different than putting up a .925 against in tight wristers, rebounds, etc.

Avalanche fan stuck in Penguin territory.

by Richard R on Jun 12, 2010 1:09 PM EDT reply actions  

Generally, the shot location I’d guess is more on the team in front of a goalie, no? Tom Awad (I think it was him) has shown that teams in front of a goalie only affect even strength save percentage by a few tenths of a percent at most. And really, with the size of the sample over a season and the different teams played, there shouldn’t be much difference between teams in regards to that. No team is so uber-talented as to find good shot location all the time.

Cидни Kросби: Александр Oвечкин, он твой папа теперь
матовая Клими, Михал нуивирт ваш папа теперь
Red Line Station: for Capitals fans who can bear reading something less intelligent than a story at Japers' Rink

by red army line on Jun 12, 2010 1:22 PM EDT up reply actions  

I wouldn’t expect the average distance for shots to vary considerably among teams over an 82 game season, and I believe you’re correct in citing Awad’s research to that point.

And RAL, do you post often over at Japers rink? I admit I’m not over there that often, but if you’ve done some work I’d definitely want to check it out.

Pittsburgh sports all the way

by GoPens! on Jun 12, 2010 2:14 PM EDT up reply actions  

If you mean comment, yes. But right now I’m just at the stage where I’m trying to understand these stats better, I think, and their utilities. I plan to do some more later, but not right now. Maybe now that my junior year in high school (didn’t help that I sort of got into these things more during my APs) is over I’ll be able to do some more work. We’ll see.

Right now I’m working on sort of a broad analysis of the various free agents at each position save goalie that might be of interest to the Caps. Checking out each guy’s PP, PK, and ES advanced stats, needless to say, is quite a pain.

Cидни Kросби: Александр Oвечкин, он твой папа теперь
матовая Клими, Михал нуивирт ваш папа теперь
Red Line Station: for Capitals fans who can bear reading something less intelligent than a story at Japers' Rink

by red army line on Jun 12, 2010 3:50 PM EDT up reply actions  

I would not have had the ability to even begin to comprehend or comment on these stats back when I was in high school. I’m pretty impressed RAL.

Pittsburgh sports all the way

by GoPens! on Jun 12, 2010 5:22 PM EDT up reply actions  

That’s what BtN’s 10 part guide is for, I guess. It helps that at JR the authors use the advanced stats a lot and inevitably that leads to discussions about the shortcomings of the metrics, and some of the people there do understand them well enough to explain it well.

I will say though if you really got into the stats only a month or two ago I’m really impressed too. What did you take to become a Pensburgh author, three weeks? I also know I’ve been using and reading about QComp and GVT for over a year but seems like you possess a better understanding than I do. Very impressive.

Cидни Kросби: Александр Oвечкин, он твой папа теперь
матовая Клими, Михал нуивирт ваш папа теперь
Red Line Station: for Capitals fans who can bear reading something less intelligent than a story at Japers' Rink

by red army line on Jun 12, 2010 6:26 PM EDT up reply actions  

That’s great that they use those stats a lot over at JR. I’ve found that good discussions in the comment threads are the best way to learn more about the advanced metrics.

I’ve been reading Puck Prospectus and some of Awad’s stuff for about 5-6 months, but I didn’t take the advanced stats too seriously until about 2 months ago. I’m still not super at using them yet, and from what I’ve read I don’t think I have a leg up on you. But I’ll take the compliment in stride :)

Pittsburgh sports all the way

by GoPens! on Jun 12, 2010 7:01 PM EDT up reply actions  

He didn’t say it was a perfect measure. He said its a better measure than wins, GAA or shutouts. He didn’t say it had nothing to do with the team in front of the goalie… just that it has less to do with the team in front than the other statistics. I’ve been a goalie for 15+ years and in my opinion save percentage is a better indicator of goalie performance than the other statistics. Its not perfect.. but find me a sports statistic that is.

I enjoyed this post.. definitely looking forward to what you come up with in your even strength analysis!

by SidgeniMalsby on Jun 12, 2010 1:40 PM EDT up reply actions  

Thanks a lot for the compliment SidgeniMalsby. Are you new at Pensburgh? I can’t say that I’ve seen you around that often.

Pittsburgh sports all the way

by GoPens! on Jun 12, 2010 2:16 PM EDT up reply actions  

I’ve been a reader for a year or two.. but relatively recently registered at started commenting

by SidgeniMalsby on Jun 12, 2010 4:06 PM EDT up reply actions  

*and started… is what I meant.

by SidgeniMalsby on Jun 12, 2010 4:12 PM EDT up reply actions  

Cool beans man. Do you play goalie in a rec league?

Pittsburgh sports all the way

by GoPens! on Jun 12, 2010 5:23 PM EDT up reply actions  

Not currently. I played roller hockey for a few years and then ice hockey in high school and intramurals in college. I just moved a few months ago from Ohio to the Philadelphia area and haven’t yet found a league.. but I’m working on that!

by SidgeniMalsby on Jun 13, 2010 11:24 AM EDT up reply actions  

mind if i ask where in philly? i’m there too.

STAAL FOR SELKE. SIDNEY FOR EVERY OTHER ONE OR JUST THE HART AND THE MESSIER LEADERSHIP AWARD. THAT IS ACCEPTABLE.

by katielynn906 on Jun 13, 2010 11:31 AM EDT up reply actions  

I’ll leave you two alone lol

Author at Pensburgh.com

by GoPens! on Jun 13, 2010 2:07 PM EDT up reply actions  

In the suburbs south of the city.. right on the PA/DE border

by SidgeniMalsby on Jun 13, 2010 9:17 PM EDT up reply actions  

Not true at all. Putting up a .925 against long slappers is quite a bit different than putting up a .925 against in tight wristers, rebounds, etc.

SidGeniMalsby’s response below is my thought exactly. I don’t believe that save percentage is completely independent of the team in front of a goalie, but there have been numerous pieces that demonstrated why save percentage is the best statistic to judge a goalie by.

Pittsburgh sports all the way

by GoPens! on Jun 12, 2010 2:17 PM EDT up reply actions  

GoPens!, i’m really glad somebody decided to take a look at this. fleury often shows flashes of brilliance, but then he’s prone to that back-breaking goal at just the worst time. i’d really be curious to see some stats showing goals within a few minutes of his team taking the lead, or within the first or last few minutes of a period. sometimes it’s not how many goals you let in, but when you let them in.

by Chez on Jun 13, 2010 1:38 AM EDT reply actions  

I agree with you that when goals are given up relative to the rest of the game can be a factor in the outcome. But figuring out when it’s most perilous to allow a goal is difficult to say the least, and I certainly don’t have the ability to try and attempt something like that.

At this stage of the game, I’m just counting up the total goals and seeing if they fit into a particular situation.

Author at Pensburgh.com

by GoPens! on Jun 13, 2010 9:33 AM EDT up reply actions  

Descriptive and Analytic Statistics

GoPens,

If individual goalies have a difference between SAve % in even strength and power play situations, the aggregate scatter plot should reflect this individual trend. Correlation could be obscured by individual variation among the goaltenders however. Rather then plot aggregate SA vs the PP SA ratio what you want is a replicated ANOVA to quantify the effect across all goalies. You’d like the effect size, the variance, and an estimate of the statistical significance. (unless you do a Bayesian, but that is more sophisticated) The descriptive statistics will literally describe the data. For example, what is difference in save percentages in the different game situations. You can then make an analytic projection about overall SA as a function of PP SA ratio. Analytic is speculative, but informed by the historical data.

Also, variation happens. I’d use a binomial to estimate the statistical uncertainty in any given year. Off the top of my head, I think the sample size limit given the number of goals will be something like +/- 0.7% over the course of a year. That is, a 90% SA goalie will fall within 89.3 and 90.7 about two thirds of the time, but outside that range 1/3 of the time. Just a rough estimate.

Meminisse Sed Providere

by TartanBill on Jun 14, 2010 9:26 AM EDT reply actions  

Tartan Bill,

Thanks a ton for the comments. Unfortunately, I’m nowhere near as fluent in statistics and statistical analysis as you are, so I’m not entirely sure about everything you said. But I’ll try and see how I do.

Regarding the scatter plot, I was only trying to see how total save percentage is affected by the fraction of total shots that came while on the powerplay. I figured a correlation would be adequate. Would there be a better way to approach that question, statistically speaking?

Author at Pensburgh.com

by GoPens! on Jun 14, 2010 10:01 AM EDT up reply actions  

GoPens

You have some great data there, very educational. I had no Idea Brodeur was such an outlier in shots on the power play.

If you had a VERY large number of goalies, the regression would work fine. With a smaller sample it is conflated with variation among individual goalie save percentages.

Try this, you already know Fleury’s Even and SH Save % as well as the league averages. Start with that. Instead of plotting, just use algebra.

SA%=TotalSaves/Total Shots
Total Shots = EvenShots+PPShots,
Total Saves = Even Saves+PPShots

GA=1.0-SA%PP *ShotsPP +SAEven*ShotsEven

Manipulate until you get a functional form you like. Divide both sizes by total shots and you get the right hand side in terms of %shots from PP and % shots even strength.

Meminisse Sed Providere

by TartanBill on Jun 14, 2010 6:55 PM EDT reply actions  

That sounds like an interesting idea. I’ll have to play around with some of the ideas you mentioned.

Author at Pensburgh.com

by GoPens! on Jun 14, 2010 7:35 PM EDT up reply actions  

Typically, goalies that win the Vezina (or get lots of consideration for it) are ones that are outliers that season on the PP. There really aren’t too many outliers for even strength, and I think GoPens! is about to find that out. Philip Myrland already did some research on this.

by JustinM on Jun 15, 2010 9:22 AM EDT up reply actions  

I actually read that article a couple of weeks ago, Justin. It was pretty informative, and it’s certainly true this season. Miller’s .919 SV% was number one among starting goalies, and the next closest guy had a .905, which is almost a full standard deviation below Miller. Insane.

Author at Pensburgh.com

by GoPens! on Jun 15, 2010 9:47 AM EDT up reply actions  

Comments For This Post Are Closed


User Tools

Welcome to Pensburgh.com - a Pittsburgh Penguins blog dedicated to building a community of, by and for Pittsburgh Penguins fans

FanPosts

Community blog posts and discussion.

Recent FanPosts

Mario_saves_small
Game Photos: 2/12/2012 Pens vs Lightning
Mario_saves_small
Game Photos: 2012-02-11 Pens vs Jets
Small
Who signs, gets traded, or walks?
Image1326398056_small
Ovechkin Still Doesn't Get It
Small
Comparing injuries and games played in the NHL
Mario_saves_small
Game Photos: 1/22/2012 Pens vs Caps
Me_small
Should Crosby Give Up His C?
Mario_saves_small
Game Photos: 1/20/2012 Pens vs Canadiens
Sheroevillaugh_small
An Addendum to "Will it ever end?"
Rothko_1964
My 20 years of being a Penguins fan

+ New FanPost All FanPosts >


Managers

Penguins_cup_08__small FrankD

Me2_small Hooks Orpik

Me_small Stephen Catanese

Editors

Mepiano_small JustinM

Authors

Dan_aeconley_small Lavender

Pens_ring_small GoPens!

Me___small TonyAndrock

Rome_small LauraZ

Moderators

Photo_small tehchico