It's a very personal choice, with pros and cons for both.
I prefer to use the dioptre adjustment in my cameras- which then entails taking my glasses off to see through the viewfinder.
You eye is a bit closer to the finder without glasses so you can see the whole screen.
Others prefer to keep their glasses on...