Thing is you can makes images smaller very easily on a PC without loosing much quality. You cant make them bigger very easily without expensive software.
So always use the biggest you can. If you need to make them smaller to put on a website or something, you can do easily.
This applies to all, not just portraits.