We struggle defensively against teams with a good outside shooting bigs and a quick guard (or guards). Rudy's man (and/or Favors' man) just stays on the perimeter and freezes Rudy (or Faves) out there, and the quick guard just drives on his man for inside buckets.
Rudy and Favors are also poor perimeter defenders right now, so teams also use their man to screen until they force a switch then exploit the mismatch. When we try to counter that by avoiding switching by going under, well....
Vogel gave opposition teams the blueprint when we hosted Orlando. It's tough to do, you need the right personnel and you have to make your outside shots. But everyone knows how to do it.