I think limiting yourself is a good idea, doing so results in two things.
1- It makes you think more about how you approach and shoot your subject whatever it may be.
2- It makes you work for the shot as you'll find your legs become your "zoom" and you'll probably find yourself exploring new & different angles.
You've got the ideal camera for this & the 35mm would be an ideal partner, the only other thing i'd suggest is limit yourself further by just shooting in single shot mode & jpg + raw aiming to get the shot right in camera so the raw's are just unused back ups.
I've been shooting in a similar manner for over a year now albeit using more than one lens and limiting myself to jpg only, no raws at all. I've found it quite refreshing and have seen my post processing go down to just crop, resize & occasionally a small contrast boost.
I have a similar set up to you in that I use an X-Pro1, XF 35mm f1.4,XF 60mm f2.4, 50mm Zeiss f2 ZM & 75mm voigtlander f2.5, currently the Zeiss lives on the camera so i'm manual focusing as well and loving every minute of it.
What makes it even more limiting for me is that I'm bed-bound 24/7 so i'm stuck in a pretty much fixed position all the time therefore can't use my feet as a "zoom" but I don't let that stop me.
So give it a go, even if its just for a day, you may well be surprised with your results.