I use a 100-400 L as well and tbh I think for bikes and being on the spectator side of the fence you need 400mm, even this can be short requiring heavy cropping.
I'm on my phone so can't post any pics but my Flickr is linked, i was concerned that it wasn't very sharp and sent my 50D and lens off for service, the camera ended up having the shutter replaced and the lens had the focusing mechanism repaired, it's a lot sharper now but I've not been racing since.
There are always loads of 100-400's up for sale, and seems to be a reasonable start price.