As you rightly point out, context is everything. I tend to think that if you're worried you've committed the unforgivable sin, you clearly haven't, by the very fact that you are worried you have. :)