Have you considered two bags?
I have 2 Lowepro Altus 160s and basically carry them both if I need everything, but if I only need a bit of gear I only take the 1 bag. I was going to get just 1 big bag but it's a bit OTT if you only want to take a bit of gear with you.