cpl size

hi all Going to have a play with cpl and nd filters, just want to confirm something. I assume I need to buy for my biggest lens and then get step down rings ? Or can I buy any size to fit one of the sizes and use up/down rings ? Just wondering if I use a small cpl/nd and use step ups, will...