Pet Shop Boys do amazing B-sides, and they are often better than the A-sides. A textbook example is Shameless, the B-side of their cover of Go West. It didn't make the Very album, and it damn well ought to have. It also ought to have been the A-side and Go West the B-side.
Other examples of favourite B-sides include Memory of You, a stunner by Girls Aloud that I'm astonished got relegated to B-side ignominy.
Away from pop and onto rock, I love some of U2's B-sides too. For example Love Comes Tumbling and their cover of Unchained Melody.