I think the word "toxic" is horribly overused. I tend to avoid it, unless I'm refering to toxins in the context of poison, venom, etc. But yes, as I said yesterday, this phrase (and many others) have become depressingly ubiquitous to the point of being meaningless, for the reasons you describe.