I don't know that it has been as obvious on the show, but in the books it is pretty clear that Varys is working HARD on the side of good. He's basically a secret agent for good.
My understanding is that he's working for the invasion by Aegon, and a lot of people think that Aegon is a Blackfyre (as is Varys).