Wednesday, January 28, 2015

Uncertainty v. Probability - Part 1

Uncertainty vs. Probability 
What's The Difference?

A weekly forecast-in-jest from 2012 by our Western U.S. Coordinator Mark Ingalls, using humor to point out although history show the certainty that objects have struck Earth, and will again, on any given day there is a very low probability of that actually taking place. 


LESSON # 1 - Identifying probability in a forecast
using this Thursday & Sunday as examples

2:05 PM EST 1/28 - With bright, cold sunshine returning to storm weary readers across the Eastern U.S., we take a moment to convey our deep appreciation and gratitude for the tremendous support you all have provided our team this winter and in the previous ten stretching back to January 26, 2004. 

We appreciate and are thankful for the generous, insightful and thought-provoking feedback submitted in our previous post regarding the January 26-27 storm forecast and the weather politics that followed it. 

  • If you are looking for the forecast, look below for details, except today it is presented as part lesson, part prediction as a learning exercise.
  • At end of the post, for those who have the patience to read and digest the content here, we reward you with a really funny, situationally appropriate video 

Sample graphic from a previous storm 
showing how 50 miles makes a big difference



In the wake of the past storm, our Leadership Team has already begun implementing enhancements to our communication of weather, uncertainty and probability on this site and in our Facebook pages. Here is a comment from a reader in one of our Facebook forecast pages that we think best sums up the situation: 

"...forecasters of every ilk should be a bit introspective when this type of missed forecast happens."

WHERE OUR IMPROVEMENTS BEGIN: To begin the process of explaining and including for our readers the importance of Uncertainty AND Probability in a forecast, we start with these three steps:
  • Examining and identifying in two existing "sample" forecasts by our team where uncertainty and probability appear in the wording.
  • How a forecaster accounts for both elements in a forecast, and why it's equally critical for readers to closely evaluate if the information represents "most probable" or "most uncertain." 
  • Why this approach to forecasting from a probablistic-based, (what we have done a long time here, and not just uncertainty-based, can aid forecasters and readers alike in avoiding the thought-process trap that can lead to under- or over-predicting a serious weather event. 

SAMPLE FORECAST 1A: Forecaster Mike's update for the Central Maryland region at 8:15 AM this morning (1/28) for the rest of the week and into the weekend.

COLOR KEY
  • GREEN represents text describing a "high probability" event
  • BLUE represents text describing an element of "uncertainty" in the forecast
  • RED denotes text that is both highly uncertain and/or low probability. 

8:15 AM 1/28 - Good morning all! Bundle up before you head outside today. The last few days of January will bring nothing but cold weather, but we do have some storm systems to talk about. The first one doesn't look like much, and the second one could be too warm to produce snow, but read ahead for the details! 


  • TODAY - Bitter cold, but at least it will be sunny with highs struggling to get to 30ยบ. Winds will be NW at 10-15 mph.
  • TONIGHT - Lows will fall back to the upper teens under mostly clear skies. Winds will die down a bit overnight.

  • THURSDAY - Increasing clouds with highs reaching the mid 30s. Winds will be in from the south. The afternoon and evening hours bring a chance for some precipitation with the next clipper system. However, most of the precipitation should be to our north. Still, we are watching for some snow showers or light wintry mix briefly during the evening rush hour Thursday.

  • FRIDAY - Colder and clearer. We'll be partly sunny and cold with highs only reaching the freezing mark again. The real issue is strong NW winds back at 15-25 mph with higher gusts. Friday night looks very cold, back down into the teens or even some single digits.

  • LOOKING AHEAD - Saturday should be colder with daytime highs in the 20s, but thankfully winds will be lighter. The next storm system is slated for Sunday-Monday. Most model projections currently send this storm to our west (which means we would be in the warm sector and get more rain), but this is worth watching for the potential for snow or wintry mix if the track changes. Stay tuned for the latest and have a great day! 

PICKING OUT THE PROBABILITY?


  1. Of the underlined sections above, can you identify and explain one example of a statement discussing a "probable" weather event or pattern vs. a statement that conveys "uncertainty" above a type of weather event? Note your findings in the comments!
  2. Of those sections you picked, suggest a way it could be worded to better convey any potential uncertainty in the expected outcome of the forecasted weather.



SAMPLE FORECAST 1B:  Forecaster Joe Fitzwater's update from Northern West Virginia as posted in the Mid-Atlantic Winter Stormcast page. Visit the page if you want to see the second section of Joe's report where he discusses storm options.

7:00 PM 1/27 - Good Tuesday evening everybody! This is Forecaster Joe, and here at the Mid-Atlantic Winter Stormcast Team, we're already watching for our next two systems to arrive. The first storm will be a VERY fast moving clipper, and we're not expecting too much in the way of travel problems with this storm, as it quickly brushes by the area during the early hours on Friday.  (WPC surface projection for Friday 1/30 at 1 PM)

At this time, our team isn't really seeing more than a dusting of snow, so though there may be a slick spot here or there, we're not talking about anything major for this Thursday. 

WHAT WOULD BE THE "MOST PROBABLE WEATHER & IMPACTS" TO OCCUR ON THURSDAY IN THE MID-ATLANTIC?
a) A surprise storm that dumps heavy snow overnight with no warning?
b)  At present, a minor clipper that could produce light snow and scattered traffic issues?
c)  A clipper producing light snow which could lead to icy patches and some traffic issues?
 d) A fast-moving clipper producing light snow with very little accumulation, but which may create some traffic issues due to timing and icy patches on roads.
Post your thoughts and reactions, (or learning exercises & results) in the comments!

LAST QUESTION Why is understanding probability and uncertainty important in your decision making? Especially in winter weather management? Because it helps you make a well-informed evaluation of what is will be the most probable weather outcome. Doing otherwise can cost a lot of extra money, lost business or missed opportunity. 

And, so you don't end up like this guy...
(scrambling for bread and milk based on a highly uncertain, low probability forecast)





LESSON # 2 - Using Scenarios in Complex Forecasts


BUT, WHAT ABOUT SUNDAY? We will use a set of scenarios to outline what we see as the most and least probable outcomes for Sunday. Long time readers know we've been doing "Boom vs. Bust" and A v. B scenarios, complete with movie quotes and lyrics,  for as long as this website has existed. Don't believe us? Here's a short list of our favorites:
  • "No Ordinary Clipper" - Post from February 15, 2010 discussing reasons why the forecast would "bust" or fail. 
  • "I have a bad feeling about this." - Post from January 31, 2010 when we first outlined the increasing probability of a significant winter weather event in the days ahead.
  • "Weather whiplash has arrived." - Post from January 26, 2011 during the "snow monsoon" that pummeled the Mid-Atlantic with snow in the morning, then rain, then 7 inches in 2 hours at rush hour, stranding thousands in their vehicles on many highways.
  • "Y'all ready for this?" - Post from February 11, 2014 outlining bust potential that never materialized as the Mid-Atlantic was hit with 8-14" in the morning, and 5-10" in the afternoon.







10 comments:

Morpheus said...

With all due respect I am less interested in rehashing the last Sunday into Monday storm and would like to see the analysis of the potential for this up coming Sunday into Monday potential snow/rain fall event. If it helps, OK, but PLEASE let's get on to looking at the near and long term prognostications for February...need something to dream about!

Anonymous said...

Agreed, any chance for Supersnow on the Superbowl?

Foot's Forecast said...

Morpheus: Please go back and examine the site again, you will notice the post is different as we were preparing an important lesson USING the forecasts coming up for this weekend.

This is an opportunity to learn and reevaluate what happened so we can improve the delivery of our services and forecasts. If we do not learn from our mistakes and that of others, we shall soon repeat them!

(Where have I heard that before?)

Yes, I stand accused of being a teacher.

Mr. Foot

ravensbbr said...

So...you're saying Friday is going to be rough...ok...cool...good to know...

:-P

Butch Dynomite said...

Maybe a feature that tells me how many cartons of eggs and rolls of toilet paper I will need purchase..

Foot's Forecast said...

Brisk morning greetings all: A heads up that we are working a new update with a much-anticipated scenario map for the Sunday situation. We plan to have it posted sometime later this morning, definitely before lunch.

-Winter Stormcast Team

Morpheus said...

Thanks for the update and apologies for misinterpreting your post. From my perspective using colors can be confusing and of no useful to color blind folks. Conveying uncertainty in a stander format forecast, for a broad audiance is difficult.

I do not come to this site for a standard forecast and I think you do a good job of convey uncertainty related to complex setup's in you break down of the possible outcomes and likelihood percentage's you place on various possible outcomes.

Just my two cents.

River Rat said...

Looks like there's a bit of hope in the weekend system. Hello everyone! I've followed storms and models for a long time but never blogged...I've enjoyed this site for years so I figured I'd go ahead and finally set up an acct.

Unknown said...

Welcome River Rat!

Flame said...

Suggestion: use bold font for something worth emphasizing. Too much colors made this a bit harder to read, and doesn't benefit colorblinded people.

Other than, thanks for the lessons! Have been following foots since 2010 snowmaggedon! New to commenting!