Well I have owned the 100-400, 400 f5.6 and the 300 f4 and they are all very good lenses, all have pros and cons. For out and out sharpness at 400mm the 456 is unbeatable it is on the same level as the big primes, but the lack of IS and poor close focus are downsides. The 300 f4 gives you the option on an f4 lens for low light or adding a 1.4x for more reach in good conditions - IS and 1.5m close focus make it a very good butterfly lens. The 100-400 is a mix of the two IS, good close focus and decent sharpness (in the real world you'll struggle to see much difference between it and the prime unless you're looking at files at 100%) and on top of that a useful zoom range.
I'd rate them as follows:
AF speed - 400 f5.6 > 300 f4 > 100-400 > 300 f4 with 1.4x
Close focus - 300 f4 > 100-400 > 400 f5.6
IQ - 400 f5.6 (just) > 300 f4 > 100-400 > 300 f4 with 1.4x
Rate them for use:
wildlife lens - 400 f5.6 > 100-400 > 300 f4
people - 100-400 > 300 f4 > 400 f5.6
general lens - 100-400 > 300 f4 > 400 f5.6
It's a matter of working out which suits your needs best, I currently use the 100-400 as I love the versatility of it but also have a 300 f4 (the old no IS version) for when needed. As for the Sigma, I have only tested it breifly but was not impressed - I know a couple of people who have bought them, all have now sold them and replaced with Canon lenses...