[TullyRunners Home Page]

Speed Rating Note 2018

Bill Meylan (Oct 8, 2018)

 

Katelyn Tuohy had a speed rating of 175.7 at the Ocean State Invitational in Rhode Island on September 22, 2018 and 177.0 at Holmdel Park, NJ on October 6, 2018.  These are the 3rd and 4th highest speed ratings I have derived for high school girls ... the top two are Amber Trotter (180.3 in 2001, Foot Locker best in Orlando, FL) and Melody Fairchild (177.9, Foot Locker Balboa Park course record).  Whenever speed ratings get some national attention like this, there are several coaches and viewers in California  that get really upset because they hate speed ratings.  I get some "interesting" e-mails and various message boards get messages highly critical of speed ratings and anybody that pays attention to them.

High speed ratings at Foot Locker, and especially Amber Trotter's 180, are the focus of criticism ... They don't believe this value and other relatively high values for both boys and girls at Foot Locker.  For those really interested ... in this article below, I'm going to show the process of deriving Amber Trotter's 180 speed rating.

And Now ... People seeing the awesome performances of Katelyn Tuohy can't believe any high school girl was ever capable of having a speed rating higher than Katelyn Tuohy ... So something is wrong with speed ratings! ... One group in New Jersey loves to criticize me and they consider Holmdel Park as "holy" ground, and nothing could be better than Tuohy's performance at Holmdel.

And this from the Letsrun message board ... "it's just his personal opinion (Meylan), but when you get a website with a large following like Milesplit using them as if they are fact and start considering them when picking wildcards for NXN then it's a real problem." ..... Well Mr. California coach, Bill Meylan has some good news for you ... A number of years back, Rich Gonzalez offered me a spot on the NXN Selection Committee, but I turned down the offer ... The NXR regional qualifiers were coming into play and I have always thought that head-to-head competition was the best selection process and that regional qualifiers give everybody the opportunity to toe-the-line and qualify.  NXN is Nike's party and I believe Nike should make up the guest list.

Some Speed Rating Basics

My XC Speed Ratings are a statistical out-growth of Speed Ratings & Figures from thoroughbred horse racing. Speed Ratings in horse racing were developed by two guys at Harvard University (Andrew Beyer and a mathematics doctoral student) ... Once developed, Andrew Beyer quit Harvard to become a full-time horseplayer, book author and columnist for the Washington Post ... the Beyer Speed Figures are included in the past performances of the Daily Racing Form and are commonly noted on horse racing TV shows (Triple Crown races and others).  Since high school XC races have many more "runners" than horse races, Bill Meylan simply extended the concept by applying additional statistical methods.

What are Speed Figures Used For ?

Speed Figures in horse racing relate the speed of horses to other horses with numbers that indicate how close they finish to each other on a relative basis ... they tell you how fast a horse has been running in its past races with a single number.

Speed Figures are a handicapping factor used for betting purposes ... The race time of the horse is irrelevant ... the numbers lengths he gets beaten by or beats other horses on a relative basis is the important factor ... Knowing the relative speed as lengths between horses helps you to bet real money.

Speed Ratings - Cross Country

Relative Time Differences between runners is the important factor in cross country (corresponds to lengths in horse racing)... I developed XC speed ratings with that in mind ... The single number tells you the relative speed compared to all other runners ... and comparing two numbers tells you the relative time difference (for example, comparing a 150 and 145 speed rating indicates at 15 second time difference since 1 point equals 3 seconds).

The entire process is designed so that a 150 speed rating anywhere equals a 150 speed rating anywhere else ... A speed rating is NOT a power rating that tells you how good a runner is ... a speed rating indicates how fast a runner ran relative to other runners.

To derive speed ratings, final times and the time differences between runners are correlated with the known speed ratings of the individual runners and known speed of specific races AND groups of runners (of known quality and speed) ... graphical and statistical comparison are made to determine the speed of the particular race being evaluated ... subjective estimations are commonly necessary in the early season, and speed ratings typically improve in accuracy as the season progresses ... Statistically, it is partly an iteration process. Good historical data is applied and helps when needed.  Statistical iteration involves guessing, but experience helps to make better "guesses" to arrive at an acceptable solution.

Reproducibility ... Anybody using my speed rating process with my baselines and libraries of past races will derive speed rating values very similar or equal to my own ... This assumes a user has a knowledge of application and some experience (absolutely required) ... Speed Ratings are not precise numbers, they are best fit approximations ... Humans and horses are imperfect and variable data points which means variable margins of error ... Some races (most with good historical data) are fairly easy to speed rate and reproducibility amongst different users will be excellent (equal or within a point or two) ... Some races are "uncertain" due to a lack of data,  so good "guesses" come into play (experience is real helpful here).

I treat XC speed ratings as if I were using them to bet upcoming races (for real) ... I want them to reflect what happens in a race relative to all other races, otherwise the utility is greatly diminished.  I tried my best to bet real money on Kelsey Chmiel at the Great Edinburgh Scotland last January because her speed rating was close enough to Claudia Lane and I knew Claudia had been sick ... in addition, Claudia was running her first XC race ever outside of California, was crossing multiple time zones to race, would be running in real mud for first time and would probably be wearing long spikes for first time ... Looked like a great betting opportunity and the United Kingdom allows betting on these types sporting events ... Unfortunately, there was betting on the Senior races but not the Junior races.

Girl's Foot Locker Race 2001

Background Information ... I encourage anybody interested in the Foot Locker 2001 races to watch the Fox Sports Net replay (start-to-finish) ... it is available on YouTube at: https://www.youtube.com/watch?v=VMrOOeMhPTA ... dominating performance by Amber Trotter and a great competitive boy's race.

It was warm and very humid at the Orlando Disney World golf course in 2001 (about 80 degrees at race-time for the girls) ... you can see dew on the grass ... the TV commentator noted the course is rather slow with many rolling hills and the turf is is soft and "spongy" with the humidity making it a strength and endurance course ... The girls ran before the boys and one newspaper article noted the girls' may have made the course faster for the guys by "squeezing" the dew moisture out of the grass making the spongy areas drier (but who knows ... the final race times tell the story for Meylan).

Amber Trotter's coach (Jerry Drew) was interviewed before the race and said Amber was healthy and "everybody knows about the anorexia problem" ... Trotter was forced to miss the spring track season because of her physical condition caused by the eating disorder ... other articles noted Trotter was improving her physical condition throughout the cross country season and was hoping for an all-out effort at Foot Locker.

Speed Ratings ... the speed ratings were determined by two methods ... (1) the known speed ratings of the individual girls were correlated with the final times and time differences between runners to "fit" (derive) a race adjustment to calculate the final speed ratings ... this is my "reference runner" method ... How fast any individual runner runs is determined by how how fast everybody else ran ... the actual final times are irrelevant (this really annoys some track coaches) ... the time differences between runners is fitted with their prior speed ratings and projected speed ratings ... as normal in statistics, outlier data needs to be excluded ... (2) the race is evaluated as a "group" based on comparison to previous years results at Foot Locker (individuals are ignored) and the race as-a-whole is compared graphically and statistically to the historical data ...Method 1 is the preferred method, and is the determining method for Trotter's 180 speed rating ... But Method 2 gets the same result when done correctly.

For starters, here are the Girls Foot Locker 2001 results with speed ratings:

 
Girls Footlocker 2001 Results (with speed ratings)

1   Amber Trotter  (12)       West        Redwood Valley      CA   16:24.07   180.3    180 
2   Erika Odlaug (12)         Midwest     Bannockburn         IL   17:04.30   166.9    167
3   Natasha Roetter (12)      Northeast   Lexington           MA   17:05.14   166.6    167
4   Molly Huddle (12)         Northeast   Elmira              NY   17:19.59   161.8    162
5   Laura Stanley (12)        South       Fletcher            NC   17:34.54   156.8    157
6   Felicia  Guliford  (12)   West        Gallup              NM   17:35.67   156.4    156
7   Jackie  Zeigle  (12)      West        South Jordan        UT   17:41.84   154.4    154
8   Valerie Lauver (12)       South       Allen               TX   17:45.40   153.2    153
9   Amber Harper (11)         West        Orem                UT   17:46.10   153.0    153
10  Heidi Lane (12)           West        Great Falls         MT   17:46.93   152.7    153
11  Julie Allen (12)          West        Corona Del Mar      CA   17:50.51   151.5    151
12  Sally Meyerhoff (12)      West        Tempe               AZ   17:51.40   151.2    151
13  Tracey Brauksieck (12)    Northeast   Cuyler              NY   17:51.87   151.0    151
14  Megan Kaltenbach (11)     Midwest     Aurora              CO   17:52.68   150.8    151
15  Kara Scanlin (12)         South       Ponte Vedra Beach   FL   17:53.19   150.6    151
16  Kristina Roth (12)        Midwest     Celina              OH   17:53.83   150.4    150
17  Mindy Sullivan (12)       South       Lubbock             TX   17:56.74   149.4    149
18  Angela Homan (12)         Midwest     Delphos             OH   17:57.27   149.2    149
19  Liz Gesel (12)            Northeast   Manchester          NH   17:58.19   148.9    149
20  Zoe Nelson (9)            West        Kalispell           MT   18:00.88   148.0    148
21  Jessica Gall (12)         Midwest     West Lafayette      IN   18:01.25   147.9    148
22  Laurel Burdick (12)       Northeast   Manlius             NY   18:03.34   147.2    147
23  Stephanie Madia (12)      Northeast   Wexford             PA   18:06.15   146.3    146
24  Jackie Mulrooney (12)     Midwest     Hartland            WI   18:08.67   145.4    145
25  Nicole Bohnsack (10)      Midwest     Rockford            MI   18:14.01   143.7    144
26  Jessica Cickay (10)       Northeast   Newtown             PA   18:14.64   143.5    143
27  Lindsay Van Alstine (11)  Northeast   Midland Park        NJ   18:16.79   142.7    143
28  Julia Cathcart (12)       South       Starkville          MS   18:23.88   140.4    140
29  Amber Smith (10)          Midwest     Ishpeming           MI   18:34.19   136.9    137
30  Carly Matthews  (12)      South       Winston-Salem       NC   18:39.23   135.3    135
31  Jessica Hellender (12)    South       Cooper City         FL   18:51.63   131.1    131
32  Brooke Stewart (11)       South       College Station     TX   19:09.99   125.0    125

Going into the race, I had comprehensive speed rating data for the three New York girls ... and tentative speed rating data for Foot Locker regionals and a few State meets outside NY ... I re-evaluated the race at a later time after collecting more data (and better data outside NY) and adjusted the speed ratings.

Some Individual Data

Molly Huddle ... the top NY girl who finished 4th ... Molly was not one of the three favorites in the race despite being really good ... I had her projected to be 4th and that's where she finished ... Here is Molly's speed rating record:

 
  Footlocker Nationals    12/8/2001    4    17:19.59   161.8    162
  Footlocker NE-Champ     11/24/2001   2    17:59.3    158.2    158
  Federation Meet         11/17/2001   1    18:02.5    156.2    156
  NY States - Class D     11/10/2001   1    18:24.5    149.8    150
  Section 4 - Class D     11/1/2001    1    17:35.0    160.3    160
  IAC Championships       10/27/2001   1    18:16.0    156.3    156
  Conwicke-Stock Inv      10/6/2001    1    16:56.0    157.0    157
  McQuaid Inv Var AA      9/29/2001    1    17:04.3    156.6    157
  Corning Invitational    9/15/2001    1    18:25.2    153.6    154	

Going into Foot Locker Nationals, Molly was solid upper 150s to 160 speed rating ... now she would be running with a group of girls faster than her, so projecting a speed rating a few points higher is within the realm of possibility ... Her speed rating of 161.8 at Foot Locker is consistent with what she had done and what she might do.

Laurel Burdick (Fayetteville-Manlius) and Tracey Brauksieck (Homer) ... these are the other two New York girls ... both schools are within 20 miles of Tully, so I was very familiar with them ... Both girls had solid upper 140s to low 150s speed ratings going into Foot Locker Nationals ... Laurel finished 22nd with 147.2 rating and Tracey finished 13th with a 151.0 rating ... Both totally consistent with what they had been doing (and slightly lower than Foot Locker Northeast) ... Here are the ratings for Foot Locker Northeast:

 
1 NATASHA ROETTER      12  LEXINGTON      MA     17:48.4    161.9    162
2 MOLLY HUDDLE         12  ELMIRA         NY     17:59.3    158.2    158
3 TRACEY BRAUKSIECK    12  CUYLER         NY     18:00.4    157.9    158
4 LAUREL BURDICK       12  MANLIUS        NY     18:13.6    153.5    153
5 LIZ GESEL            12  MANCHESTER     NH     18:19.4    151.5    152
6 JESSICA CICKAY       10  NEWTOWN        PA     18:20.5    151.2    151
7 LINDSAY VAN ALSTINE  11  MIDLAND PARK   NJ     18:24.5    149.8    150
8 STEPHANIE MADIA      12  WEXFORD        PA     18:26.7    149.1    149

The other Northeast girls (places 5-8 at regionals) had slightly lower ratings at Nationals (but it turned out those ratings were more consistent with their seasonal ratings leading to Foot Locker Northeast which is not uncommon) ... It is common for some runners to have their best speed rating at qualifiers because that's how you make it to Nationals ... getting there is Job #1.

Natasha Roetter ... she beat Molly Huddle handily at Foot Locker Northeast ... the times at Foot Locker Northeast were relatively slow because it was cold and rainy (but time differences are still time differences) ... Natasha finished 4th at Foot Locker Nationals in 2000 (155 speed rating and the top returner) ... she was undefeated in 2001 and had been running significantly faster times at meets than the previous year ... many observers thought she was the true favorite ... she was already a 162 speed rating, and now she would be running competitively with other girls as fast as her ... certainly possible her rating might rise ... BUT let's see how fast she runs compared to other runners (e.g. time differences) ... The time gap between her and all other Northeast got bigger, including Huddle (which indicates a possible higher speed rating for Natasha ... and that's exactly what happened).

Ericka Odlaug ... ran a very smart race at Foot Locker ... let Huddle and Roetter pace her, and out-kicked Roetter right at the end ... Broke 12 course records in 13 races (she did not break the Footlocker Midwest course record; it was completely rain-soaked and muddy) ... The Illinois girls were racing a 2.5-mile distance in 2001 ... Erika Odlaug had shattered that Detweiller Park record earlier in the season by over half-a-minute ... She won the IL State Meet by 45 seconds ... Yes, Meylan had to "guess" (I dislike 2.5-mile championship races), but she was at least in the upper 150s to low 160s range ... The previous outdoor track season, Erika Odlaug won the Golden West 2-Mile (10:11.31), was 2nd at the adidas Outdoor Nationals 2-Mile and then won the Junior National 3000 Meters over bunch of college runners ... So she was pretty fast ... and she was helped by getting pulled to fast time at Foot Locker ... her 166.9 speed rating was not a surprise to me ... BUT probably unbelievable to some California coaches because Meylan's Foot Locker ratings are all inflated.

Other Runners (except Amber Trotter) ... Making a long story shorter ... lots of consistency with their Foot Locker ratings versus other race ratings!

Amber Trotter ... followers of speed ratings can recognize this - The race adjustment and speed ratings of the race has already been determined, and I haven't even considered Amber Trotter's performance ... Amber Trotter's speed rating has been determined by the other runners in the race ... How fast they ran relative to each other determined the race adjustment ..... The exact same principal determined Katelyn Tuohy's ratings at Holmdel and Ocean State.

Amber Trotter was a work-in-progress during the 2001 XC season ... Her best speed rating entering Foot Locker Nationals was roughly 164-167 achieved at Mt SAC ... very comparable to Sarah Baxter and Claudia Lane ... It was obvious the Mt SAC course ran slow for Amber Trotter compared to current years ... Based on her 2001 ratings entering Foot Locker, I would project her at mid to upper 160s (she had a 153.0 rating at Foot Locker 2000) ... But Something else happened (Wow did something else happen).

She broke the course record by 31 seconds, but speed ratings don't care about that ... speed ratings care about the time differences between runners of known ability ... Amber Trotter beat Molly Huddle by 55 seconds (or 18.3 speed rating points) and she beat Ericka Odlaug and Natasha Roetter by 40 and 41 seconds ... and all the other runners of known speed ratings ... And collectively, the other runners in the race determined Amber Trotter's speed rating of 180.3.

For those believing Amber Trotter's speed rating is greatly inflated ... If I dropped her rating at Foot Locker by 10-15 points, I would need to drop everybody else's by 10-15 points and that obviously make no sense at all ... I think that would be disrespecting a lot of talented females.

 

Some Stats of Interest

Here are the official race splits ( http://footlockercc.com/2001/ ):

 
Amber Trotter's Splits:      Boy's Splits (Tim Moore):
  800m        2:30             ---
  1 Mile      5:04            1 Mile      4:40
  2 Mile     10:24            2 Mile      9:32
  2.5 Mile   13:05            2.5 Mile   11:59
  3 Mile     15:45             ---
  Finish     16:24            Finish     14:50

Trotter  had a 23 second lead at 1-Mile and 33 second lead at 2-Miles ... she averaged 5:15 per mile for 3 miles ... Her 13:05 time at 2.5 miles is 16.8 seconds faster than Katelyn Tuohy's 2.5 mile course record at Van Cortlandt Park.

The Boy's 2.5 Mile split is 4 seconds slower than Edward Cheserek's course record at Van Cortlandt Park ... and the Boy's final time is 3 seconds faster than Edward Cheserek's course record at Holmdel Park of 14:53 (Cheserek's speed rating was 208 and Tim Moore's rating at Foot Locker was 207) ... New Jersey guys thought Cheserek's rating was a bit low ... and the California contingent thought his 210 at Foot Locker was inflated.

Katelyn Tuohy ran 16:21 at Holmdel ... Amber Trotter ran 16:24 at Foot Locker ... as noted in the New Jersey Shore Coaches Holmdel results, Holmdel ran about 9-10 seconds fast compared to Cheserek's record race, so adding 9 seconds to Tuohy's time yields 16:30 to make it comparable to Cheserek. 

 

One Graph to Annoy Those Who Hate My Graphs

The speed rating course adjustments for the Girls for Foot Locker 2001, Foot Locker 2017 and NXN 2017 were not that far apart ... Just for fun, I merged the results from Foot Locker 2017 and NXN 2017 ... I merged them because NXN did not exist in 2001, and in 2017, the talent was divided between NXN and Foot Locker ... Levels the playing field for comparing the 2001 race to the 2017 races (in terms of quality) ... I used the top 26 from the merge for the comparison ... The graph is simply the raw data plotted with some labels:

The graph displays a very nice consistent match in quality with runners in finishing positions 6 through 23 ... Another nice matching comparison involves Molly Huddle and Kelsey Chmiel ... Molly Huddle's speed ratings are posted above ... New Yorkers will recognize that Huddle's and Chmiel's ratings look like clones of each other ... and in the graph above, their data points are very close to each other (Chmiel was 159 at NXN and Huddle was 161.8 at FL, and Chmiel did a 161.7 this season); just another indication of relative comparison.

Trotter's 180 is nicely displayed in relation to Tuohy's 172.