My take on swearing is much the same as yours, ie context is everything. If it is dramatically called for, or in character, do it. Otherwise, don't.

I've only used strong language occasionally in my novels, when I felt it was vital (Peaceful Quiet Lives is an example).