@Barrysprout has owned both 35mm's
Your X-E2 is not weather sealed so I wouldn't get too excited about WR being a priority.
If you get a 35mm you might want to consider adding the 14mm rather than a zoom as that will give you good coverage between 14mm and 56mm
I have both the 18-55 and 18-135, the former is built better and probably optically sharper however the 135 has better OIS and obviously a bigger range. However it is quite a big lend and not as well balanced on an X-E2
Don't discount the 50-230 for longer reach, this is very good optically, and the lower cost plastic body makes it a bargain s/h buy
But..... None of these lenses are as sharp as the 23 and 56, though the 14mm is close. I've not owned the 16mm but a lot of people say that is good as well.
Does that help??