Looking at the comparison pictures there doesn't look to be a whole lot in it but as you say it may feel smaller in the plastic and metal. If there isn't really all that much difference in size maybe an X-T1 could be a better option but what about the firmware updates? Is it at all possible that Fuji could stop updating the X-T1 firmware at any point whilst continuing to release updates for newer models?
X-T1 is still the flagship not the x-t10, it will be getting all the x-t10 fw updates soon enough. Fuji has a much better track record than other manufacturers in terms of FW updates, they continue support for older models a good few years after launch.