How about a bit of both then? Have weather on, but just not as much? Say half the time of rain/snow/storms and the frequency it happens, so it doesn't rain/snow as often as it commonly does?

And as Laegluin says - you can easily turn the particals and visuals of the rain off, so it really is just a darker blue sky for you. Still gives you a more adventure survival aspect yet no annoying rain to come with it. :3