Hmm, I doubt the 50D is decoding the raw files, possibly the refresh is just a UI thing where it zooms the pixels it has whilst it fetches the real data from memory.
It would be nice to have a camera that let you pixel peep at 100% zoom a raw image file rather than a low res and fluffy jpeg.