Reflections on the Western States 100 Lottery System

Western States 100 logo[Thomas Williams originally wrote this for his blog Twenty-Five Squared, but was kind enough to share it with the iRunFar audience.]

I did not enter the lottery for the 2011 Western States run, and I’m not entered otherwise, so I can claim at least some objectivity for the following critique of the lottery process that follows.

For the 2010 run, it became clear that the “two-time loser” policy for getting into the run – not picked in the lottery two years in a row; you’re in the next year, assuming you qualify – had to go; the numbers became impossible in that before very long the entrants would be entirely two-time losers, and even then impossible in the context of the cap imposed by the Forest Service for the number of runners who can pass through the Granite Chief Wilderness at one time. So there had to be a change. So no more two-time losers. Instead, for every year you did not get selected in the lottery, you would get an additional ticket the following year, assuming you qualified and wanted to enter. If you were not selected one year, you would have two tickets next year; if you were not select the second year, you would have three tickets in the following year, and so on.

This process will not work. The odds for people with multiple tickets never improve as much as might seem intuitive. In fact, depending on how many people enter the process for the 2012 run, it could actually happen, and pretty easily, that the odds for the three-tickets holders are worse than their odds the prior year when they held two tickets. The odds for multi-ticket holders will never be 50 percent, or even close, as was reported at the lottery for the 2011 run.

The Western States lottery fits a type of statistical problem that has the scary name hypergeometric distribution. It is like a binomial distribution (itself, not a very comforting name) except that there is no “replacement,” which means that if your ticket is drawn, you are removed from the process; in other words, you cannot get selected more than once.

For the 2011 run, there were 2115 tickets in the lottery, 1113 for people who had one ticket and 501 times two for people who entered the process for the 2010 run, did not get selected, and wanted to try their luck again. There were 213 slots available before the “had to be at the lottery” selections. If you plug those numbers into a hypergeometric distribution (Excel makes it pretty easy to do that with the HYPGEOMDIST function), the result is that people who had two tickets had a probability of being selected of just over 18 percent, while people with one ticket had a probability of just over 10 percent. These probabilities are from the point of view of being selected once during the entire process, not the same as the probability at any individual draw, so you might say from the cumulative perspective. Put another way, the probability of a person having two tickets not getting selected at all was about 82 percent, and for a person having one ticket about 90 percent, given 2115 total tickets and 213 spots available.

As the special-consideration entrants continue to come into the run, it is hard to tell now how many one-ticket holders got selected, and how many two-tickets holders, during the lottery process. Of the 1113 one-ticket holders originally listed, 963 are now listed, while of the 501 two-ticket holders originally listed, 400 remain listed. This means 150 from the one-ticket holders and 101 from the two-ticket holders, which means that almost 14 percent of the one-ticket holders got in – by one means or another – and just over 20 percent of the two-ticket holders got in – not too far off the statistical expectation. But the total, 251, is more than the total selected at the lottery, 213. So let’s just guess that 120 of the one-ticket holders were selected in the lottery process while 93 of the two-ticket holders got in. That would put the probability very close to exactly the statistical expectation, which might give us some confidence in the statistical analysis.

So, the probability for the two-ticket holders was not as good as we might have thought, but surely, next year, when the new form of “two-time loser” has a third ticket, the odds go up? Maybe not. The odds could go up, but could easily go down, and in any event remain lower than might intuitively seem to be the case. Let’s say that for the 2012 run we have 1000 one-ticket holders, 700 two-ticket holders, and 300 three-ticket holders, assuming that about two-thirds of the one-ticket holders who did not get in for the 2011 run decide to try for the 2012 run and maybe three-quarters of this year’s two-ticket holders decide to try their luck again. How do those numbers crunch in a hypergeometric distribution? The one-ticket holders would have a probability of a little over 6 percent; the two-tickets holders, a little over 12 percent; and the three-ticket holders, just under 17 percent – worse odds for the three-ticket holders than they had as two-ticket holders. Let’s stretch the guesswork out to include 200 people who hold five tickets for the 2014 run and 250 people who hold four tickets; the odds for the five-ticket holders are about 17 percent – still less than their odds as two-tickets holders. This process does not work.

All numbers aside, I find myself more concerned about the purely human effects involved. In a statistical distribution, there are “outliers” – a few very lucky people and few very unlucky people. I am concerned about what is obviously some pretty significant emotional devastation for some really unlucky people who work themselves to the bone year after year to have a shot at getting into the Western States run and do not get in. This problem is well known, used to be solved by the “two-time loser” policy, does not have a new solution, and is not helped when people are just as competitive about getting into the run as they are about running the event.

I don’t have any bright ideas about how to fix the problem, but I think that we need to open the discussion and, for whatever ideas make the initial cut, apply some probability theory to them and see how they shake out. Let’s not forget that people are involved here, and that the system should be as fair as all the people who care about it have brains to make it fair. One thing that I think would help the larger process is transparency about the selections. Each person in the run should have an annotation about the selection method, such as “got in at the lottery” or “selected by Michigan Bluff aid station” or “Montrail sponsor selection” or “won Miwok” or “the Board feels that this runner will bring a lot of good beneficial publicity to the race.” It does not well serve the Western States run the impression shared by many of a “smoked-filled room” of special consideration. Perhaps people could apply for special consideration, make their case in writing, and be subject to a vote of the applicants, of the people.

Call for Comments
I welcome your comments, and especially your ideas on a sound method for statistically improving ‘lottery loser’ odds from one year to the next, so that the odds not only increase from one year to the next but increase significantly, such that the possibility for the truly unlucky never to be selected, year after year, would be very, very small, unlike the current system.

I should mention that, as far as statistics go, I am a hobbyist at best, and I really welcome input from those who are more than that.

There are 66 comments

  1. Joe Pham

    I have mix feeling about this subject. I had entered lottery 8 times, got select twice via 2-times looser and I am still looking for my first finish @ WS. My suggestion is having 2 WSs: one for fast end elite runners with very high qualification (an Ultra championship type) and one at later date with current qualification. That will make WS available for more runners, both fast and back of the pack, and still meet the maximum quota restriction.

  2. Bryon Powell

    Unfortunately, WS can't have two events unless they heavily modify the course. The maximum quota is for a single event and short of legislation, another event cannot be added at another time during the year.

  3. Conno

    WS should make it so that they take the top qualifiers. Have a series of 50/100 miles around the country that are considered qualifying courses. Then take the top 369 time or how ever many entrees are allowed. No lottery, no tightening the qualifications just the best runners racing. Leave your 10-15 spots for the elites and fill the rest.

  4. Jessica Lynn Barney

    i think that there should be a certain standard of time they shold reach inorder to get the serious runners first prioritys rather than the ones who are doing it for their own pleasure and then they should reserve about 3.7/4 of the spaces for people who dont make the qualification time and then allow them to do the lottery system so that way priority runners have first served and pleasure ones have 2nd served.

  5. George O

    Why not just go out and run 100 mile at your local trail. Have we forgotten the true and real reason we consider ourselves ultra runners? Do we not run just for the love of it, for the nice warm feeling we get from it, the feeling of freedom that it provides us, an escape from the chaotic world we live in? It seems like people are stressing so much about getting a spot into WS that if not accepted it will forever ruin their life! Do we really need to have our names posted on a website indicating that we ran 50k, 50 miles, 100 miles in order to feel fulfillment? Do we need a buckle as proof that we ran 100 miles? Would one not feel the same level of accomplishment if one were to go out and run 100 miles with a couple of buddies or on your own during the course of a weekend? No one would have to know you did it except you and anyone that came along for the ride (or run :)

    I go out and run everyday, most weeks I log 80 plus miles and I go where my body can take me for as long as it can take me. Sometimes I run up and down steep mountains for hours and then go home take a shower and head to work. At the end of the day, I have no buckle or award, or even anyone cheering for me at the finish line (wherever that may be) but I am satisfied with myself feel fortunate that I (my body) was able to provide me once again with the love and joy of running.

    Run free


  6. Jared Friesen

    The problem though with a sub-3 hour qualifying time is a race like Hardrock. What if a person runs Hardrock in 32 hours, they can't use that for a WS qualifying time? Seems unfair. I say keep the qualifying time in place, get rid of the multiple ticket rule, decrease the chances for automatic entry (like Hardrock), and most of all, go AROUND the forest service area so you can increase the number of starters.

  7. Jared Friesen

    This goes back to Gordy's take on it, go AROUND the forest area! This alone could very well increase the starters by more than double since the forest area is the whole issue. Sure it would involve a course change, BUT, how many would be in favor of that for the reward of more starters?

  8. Jared Friesen

    The other option is WS could get rid of all automatic qualifyers (such as Ultra-Cup) and only hold 20 slots for top 10 male and female of previous year, plus say about 10 more for board discretion. The rest could go to lottery for those who have not finished the race in the past 5 years.

    But I say, change the course and go around the service area, that is really the big issue with the number of starters. Maybe push to get a similar course that could do 500-1000 runners. You could even go for broke and get 1000+ and do it UTMB style.

Post Your Thoughts