The camera is very relevant in this case.
Ignoring all of the info about power-on cycles and wear... the biggest battery drain on an X100* is likely to be the EVF and screen - both of which may be reactivated as you move (the eye-sensor would be the most obvious candidate rather than bumps to any buttons).
Left alone, the camera will go to sleep (I've pulled my Fujis out of a bag days later to find that they haven't been switched off), but conversely I've found the screen running live view as I walk along a street because the camera hasn't been able to detect that I'm not using it (in this respect the Fujis are very different from traditional dSLRs).
If I'm in the studio, I don't worry about switching it off (it's in my hand or on a table). If I'm out and about I'm inclined to switch it off to stretch the battery life and also to prevent accidental shots (though that's not quite so easy with a Fuji as it is with most dSLRs).
Compared to most dSLRs, Fuji X-series don't have great battery life (and the power level indicators generally give very little warning from full to empty). However, given the weight of the gear and batteries, carrying one or two spare batteries isn't a hardship. From experience, if you're unsure about the state of the battery charge it (and carry a spare).