Autumn Quarter 2004 Atmospheric Sciences 101 Rain Forecast Competition



Introduction

The forecasting contest counts for 5% of your overall grade, and will be graded on a 0-20 point scale. The goal is to forecast whether it will be raining or drizzling (or even snowing) on Red Square at 10:30 am on the next day. Prof. Bretherton or a designated representative will validate the forecast.  Any drizzle droplets falling from the sky that can be felt on the skin during a five minute period, no matter how light, will count as rain. So will any snowflakes we see landing on Red Square. Forecasts should be made for all weekdays starting Tuesday 2 November and ending Friday 3 December, with the exception of Thanksgiving holiday (Thursday and Friday 25-26 November). Please do make a forecast for Veterans Day (Thursday 11 November). 

The forecasting contest will be graded on a scale of 20 points. Students who submit a minimum of 15 of the 22 possible forecasts will automatically get 10 of the 20 points. The remaining 10 points will be awarded based on the cumulative error points of the forecasts, as discussed in the Scoring section below. Students submitting less than 17 forecasts will receive no credit for the forecast contest. 

Before you begin forecasting, you need to sign up for the competition. When you do this, you will provide your student identification number, a pseudonym (nickname) and a password. This will allow you to enter forecasts anonymously and prevent other people from entering forecasts for you. It also allows everyone to check each other's progress without revealing true identities.

 

Rules

  1. You are forecasting the probability that it will be precipitating (raining, drizzling, or snowing) on Red Square at 10:30 am on the next day.  Forecasts must be entered by 11:30 PM the previous day. The software will not allow you to enter a forecast between 11:30 pm and midnight, so don't be late. The clock on the entry form is used to determine the forecast day. It updates every minute.
  2. As your forecast, you will enter a whole number from 0 to 10. 0 mean a zero chance of precipitation, 1 means a 10% chance, 2 means a 20% chance,..., 10 means a 100% chance. 
  3. The first forecast will be for Tuesday, 2 November and can be made anytime before 11:30 PM on Monday, 1 November.
  4. The last forecast is for Friday, 3 December  (i.e. entered on Thursday). The final results will be posted before the last day of class. Remember that you only need to submit forecasts on Sunday through Thursday evening.
  5. You may re-enter your forecast as many times as you like until the 11:30 PM cutoff. Only the last forecast you enter will actually be scored.
  6. On days you do not forecast, you will automatically receive a 0 forecast (no probability of rain).
  7. Pseudonyms deemed inappropriate will result in the entrant receiving no credit for participation. You are responsible for remembering your own pseudonym and password. If you forget your password, contact your TA and he will remove your password from the file to allow you to enter a new one.
Scoring

For each forecast, error points are assigned as described below. The objective is to have the lowest overall error point total accumulated over all 22 forecasts. In the beginning, all forecaster's scores appear on a red background. Once forecasters have entered the required minimum number of forecasts (15), their scores appear on a green background.

For each submission, daily error points are accumulated as follows:

  1. Daily error is (Actual Precipitation Occurrence - Forecast Probability of Precipitation)2 to a maximum of 100 error points.  The 'actual precipitation occurrence' is taken to be 0 if it is not precipitating at Red Square at 10:30 the next day, and 10 otherwise. Note that the difference is squared.
Example: Bluesky forecasts a 4 (40% chance of rain the next day). If it does not rain, she gets (0-4)2 = 16 error points.  If it does rain, she gets (10-4)2 = 36 error points.  Unless you are sure, shading your bets is a good idea. Don't go too high - even in November it is not raining more often than it is raining. We don't have a climatology for helping you with this forecast, but I'd guess that probably it will be raining about 20-30% of the 10:30's that you have to forecast for.

Forecast contest grading (out of 20 possible points)

  • 10 points for completing 15 forecasts.
  • 3 points for placing in the best 80% of student forecast error scores.
  • 3 points for placing in the best 40% of student forecast error scores
  • 2 points for placing in the best 20% of student forecast error scores
  • 2 points for winning the contest with the lowest forecast error score in the class.