I work in finance; if you came to me with these sorts of concerns I'd think you a paranoid lunatic.

Lock your screen when away from your desk, but no one is going to be pulling the secret sauce from your systems by occasionally going into your office to ask if you'd like a cuppa.