You don't need "MF Assist" to be on, I have mine off, but there is a setting for "AF+MF" and I have mine on. This allows me to AF and then tweek manually without the magnified view coming on. There is of course the AF/MF button on the back too.
All this is with the Panny 20mm f1.7 so I hope it works with your lens.