A big part of a tv announcers talent are their voices. Boler has a great voice, but misses a bunch of stuff. If a person thinks women shouldn't be announcers in sports, then I agree with your statement.
Doris Burke, Cheryl Miller, Beth Mowins and Lisa Salters come to mind of basketball announcers with good broadcasting voices.
However, if because she is a woman, she is above reproach so no one can say they don't like Holly's broadcasting voice, and think she is awkward in the broadcast, etc. that is some b.s.
I wasn't a big fan of the pre-Holly broadcast team either, but Boler, Matt and Kristen were much more enjoyable than what we have now.
Similarly I can stand Mark Jackson or Joe Buck, both speak monotone with no emotion.