Showing posts with label Score Effects. Show all posts
Showing posts with label Score Effects. Show all posts

Wednesday, January 25, 2012

Why Do Score Effects Exist?

First off, I must thank and give full credit to 2+2 poster atakdog. Most of this article is just a small model tweak and different presentation of his work in this post. Worlds are colliding!

We talk a lot about score effects. The idea is that when a team is behind they will tend to dominate and teams that are ahead find themselves in their own end more often than when the score is tied. This occurs because teams have different incentives - if you are ahead then preventing the other team from scoring is more important than scoring yourself, so you'll play less aggressively forcing the other team to work for it. Similarly, if you are behind then scoring becomes far more important so you are willing to take chances, pinch with your defensemen, have them jump into rushes and so on.

In this article, I will take a look at score effects by graphing out the incentive to score and prevent goals. In future articles, to come out in the next week, we will use a similar methodology to look at how the points system (2 for any kind of win, 1 for an OT/SO loss, 0 for a regulation loss) affects incentives and whether there might be better systems out there.

A Simple Model

It wouldn't be a JaredL article, or an atakdog derivative for that matter, without introducing a model. To look at the incentives to score and prevent goals, I took the average goals per team per game since the lockout, about 2.88, and divided by 60 to get the average goals per minute, roughly 0.048. I made this number the probability of either team scoring in any given minute. Using backward induction, I determined the probability of winning the game any given minute with any score difference. So this is two average teams facing each other, scoring at the average rate each minute and each with a 50% chance of winning the extra point in overtime/shootout should it get that far. I also assumed that if at any point in the game one team is up 10 goals then they will certainly win.

You may find it a little strange that we're looking at score effects using a model which assumes that they don't exist. A good way to think about this is to ask what happens if the other team plays exactly the same way no matter what the score is. How should we respond?

Score Tied

Let's start with the score tied. If this were baseball, basketball or either North American brand of football, this would be simpler. Unlike those sports, the NHL tiebreaking rules make hockey games non-zero-sum. If two teams tie, then the total number of points both get goes from 2 to 3. Note that in soccer it is exactly the opposite - if a game ends in a draw, the number of points drops from 3 to 2. The NHL rules actually make the incentive to score and prevent goals different when the score is tied, which we'll cover in greater depth in future articles.

Here is a graph showing the marginal benefit, in league points, of scoring and preventing a goal with the score tied. The horizontal axis represents what minute of the game it is and the vertical how many expected points are gained by scoring or preventing a goal. For scoring this would be the difference between starting the next minute up one and starting the next minute tied. For preventing this is the difference between starting the next minute tied and starting it down 1.


This gives us a somewhat strange pattern. Early in the game, scoring and preventing goals are about equally important. When the score is tied you will gain or lose about a third of a league point on average if a goal is scored. Very late in the game, this changes and getting to the 1-point-bonus round becomes the important thing. It's easy to see why we don't like this, but let's move on and look at score effects right now.

The One-Goal Game

Let's now shift to the score not being tied and start with the team that is ahead in a one-goal game. Here is a similar graph:


You can see that every minute of the game preventing a goal is more important than scoring. It's an interesting coincidence that at the start of the third period preventing a goal is almost exactly twice as important as scoring one. I think this is a bit overstated because my model does not take into account a team pulling the goalie, which I think will make it just a bit more important to be up 2 goals. Something worth noting is that the points system somewhat cushions the cost of conceding a goal here - if you are up one then giving up a goal very late isn't all that bad, at worst it costs you just over half a league point. Perhaps paradoxically, it's worse to give up a late goal when the score is tied than when you are up one.

Here is the graph for the team that is losing:


Perhaps the most clear thing from this is the already obvious justification for pulling the goalie - the last couple minutes giving up a goal almost doesn't matter at all while scoring is worth close to a point and a half. I've wanted to take a closer look at the optimal time to pull the goalie for a while, and hopefully will get to it, but just eyeballing this graph it seems earlier than usual might be better.

Another thing about this graph is that it provides some justification for the definition of close game, I believe first proposed by Eric T. over at Broadstreet and now used by many, including Gabe Desjardins for his power rankings, which he posts far more regularly than I (coming soon, I promise!). Under that definition, a game is close if it's within a goal in the first two periods and tied in the third. While such a definition is always somewhat arbitrary, we can see some justification for it by noting that the incentive to score for the team that is behind stays relatively flat earlier but really moves upward in the third period.

Something worth noting is that it is far more important for the team that is behind. Scoring a goal right at the end of regulation is three times as beneficial for the team that is behind than it is costly for the team that is up. Again, this is due to extra point being given in tie games. To better see the size of these effects, here's a graph with all four together:


Based on these incentives, it's not surprising that so much more of the play is in the leading team's end of the ice. The key for both teams is putting the puck in or keeping it out of that goal. The later in the game, the stronger this effect is and that's mostly because of how big a goal would be for the team that is behind.

Two-Goal Games

I'll be very quick with two-goal games and just show the combined graph. Here it's interesting because right near the end of the game it basically doesn't matter what happens - with a minute or two to go the team up two goals is almost certainly going to win whether they give up a goal or not. The key time is 10-15 minutes out when the trailing team has a decent chance to get another goal and equalize. Again, this slightly overstates the case because it assumes teams leave their goalie in there at the end, but the overall shape of the graphs would be mostly the same:



Score/Prevent Benefit Ratio

Finally, here's a graph of the ratio of the marginal benefit of scoring to preventing the other team from doing the same based on the score and time. The larger this is, the more important scoring a goal is relative to preventing one. If the ratio is greater than one that means scoring is more beneficial than giving up a goal is bad, the opposite if it is less than one.


I cut it off at 5 because it shoots way up for the team that is behind. With two minutes to go, scoring becomes 40 times as important as preventing the other team from putting the puck in your net if you are down 2. It is very clear that while teams that are ahead have some incentive to play more defensively, most score effects are driven by the team that is trailing.

In the next installment, I will look at how score effects, and play with the score tied, would be expected to change under alternative points systems such as 3-2-1-0, the simple 2-1-0 with ties at the end of regulation and the soccer system which is 3-1-0.

Wednesday, June 29, 2011

Putting Skaters in a Context: The World of Advanced Hockey Metrics

With the world of advanced hockey metrics continually improving, we are now beginning to see hockey players evaluated in more diverse ways than ever before. Since the beginning of many a hockey fandom, a quick glance at a skater’s goals, assists and total points has been the measure that grades offensive prowess across the league’s scorers. Now, however, the emergence of a few newer (and quite frankly, better) statistics allows us to take these age-old points totals and put them in a context, showing just how valuable a player may or may not be to his team’s success. Here at Driving Play, while attempting to evaluate different players across the league we will be commonly referring to many of these newer statistics within our analysis. Below is a quick list that will attempt to make clear just what we may be referring to if an unfamiliar term happens to appear within one or more of our posts.

A Corsi Number – Similar to a +/- statistic, Corsi gives a player a (+) upon the event of his team generating either a shot on goal, a missed shot, or a blocked shot directed at the opponent’s net while he is on the ice. Similarly, a player earns a (-) if the opponent generates a shot on goal, missed shot, or a blocked shot directed at his own net. Sometimes this can be expressed as a percentage, i.e. the percentage of the total shots that are directed at the opponent’s net while a player is on the ice. Corsi can also be expressed in a “Relative Corsi” number which is the difference between a player’s on-ice Corsi score and the shot differential while he is on the bench. Relative Corsi is generally used to look at which players are having the most positive effects on shot totals relative to their teammates.

A Fenwick Number – Since many consider shot-blocking a measurable skill in the hockey world, a Fenwick number is the same as a Corsi number, except blocked shots are taken out of the equation. So, a player will earn a (+) if his team generates a shot on goal or a missed shot whilst he is on the ice, and a (-) if either event occurs for the opponent.

Quality of Competition (QUALCOMP) – The fact is, all ice time in the NHL is not created equal. Having to line-up toe-to-toe with Sidney Crosby is a much different task than Jesse Winchester, the hockey player or the musician. QUALCOMP more or less weighs the on-ice +/- (the familiar statistic measured in goals) of a player’s opponents relative to the rest of his teammates, and averages this rating across every player faced during the season. The higher the resulting rating, the better the competition a player is facing and vice versa. There is also a CorsiRelQUALCOMP number which does the same thing, except uses Relative Corsi instead of +/-.

Quality of Teammates (QUALTEAM) – Similar to QUALCOMP, QUALTEAM weighs a player’s teammates using the exact same formula as QUALCOMP. Just like QUALCOMP, a player’s QUALTEAM rating will be higher if he is playing with first-line teammates and vice versa if he is playing with fourth-line enforcers. Also similarly, CorsiRelQUALTEAM will measure a player’s teammates using Relative Corsi.

Zone Start Percentage – A zone start percentage measures the percent of the time any player starts his shift in the offensive zone. As you might expect, players with a high defensive prowess are often called upon to start in the defensive zone frequently, and vice versa is true for those players who are more inept in their own end. This particular statistic is important in that it can directly affect a player’s aforementioned Corsi or Fenwick percentage since players who are starting in the offensive zone more frequently will have an easier time generating more shots towards the opponent’s net. What’s more, players who are more immediately deployed in defensive roles will have a harder time finding shot opportunities than their counterparts who are already starting in prime offensive positions. 

Score Effects – Within the ebbs and flows of a hockey game, it has been a long-believed ideal that teams will go into more of a “defensive mode” while ahead and try and get just about every shot possible on net while behind. Using Corsi and Fenwick percentages, it has been shown that teams who enjoy an advantage in the score are commonly outshot at improving rates as the game progresses and vice versa. With the score tied, the disparity in shot totals is most close to even which is why many advanced hockey statisticians choose to look at Corsi/Fenwick with the score tied at even strength to put players’ ice time on a level playing field.

Coming back to the original point regarding putting different skaters in a context, we are now able to more closely examine the situations that different players are playing in. For this reason, it is now much easier to come to a conclusion about their value to their respective teams. Before these statistics came into play, we could look at two players, Patrice Bergeron and Ville Leino for example, who had similar point totals during the regular season (57 and 53 respectively). In a vacuum, it may seem as if they are both comparable players toward Boston and Philadelphia’s total success. However, a little scratching beneath the surface reveals that Bergeron played against much tougher competition than Leino, and Leino enjoyed the luxury of skating with better teammates. Leino started in the offensive zone a walloping 62.3% of the time compared to Bergeron’s 42.7%, showing us that Leino was given far more prime scoring opportunities to begin his shifts which undoubtedly had a positive effect. Finally, Bergeron’s Corsi and Fenwick percentages with the score tied at even strength were 52.7 and 52.8% respectively, compared to Leino’s 54.9 and 53.1%. While a higher percentage of the on-ice shots were directed at the opponent’s net while Leino was on the ice, we have of course already noted that Bergeron faced tougher opponents and played with worse teammates than Leino which gave Leino an advantage in putting up better numbers in these categories. Had Leino, a notoriously subpar defensive forward (see: 2 seconds of average shorthanded time-on-ice/game in ’10-11) been given minutes similar to Bergeron’s, the point totals most certainly would not have looked anything similar. Considering the minutes they were given, Bergeron most certainly had an excellent season while Leino performed at a level around what we might expect from a forward given “softer” minutes during each game.