see my update though, I'm almost never in a physical situation so it's not really something I worry about
Almost never is between never and sometimes. I encourage you to take a boxing class. Rather have it and not need it then need it and not have it, like a gun. Even having the appearence of being able to handle yourself acts as a deterrant against demonic foes. These types of people usually pick on the weak. Dont be that man.

(exhales)