Although Jackson didn't bring up race, do you honestly believe he wasn't comparing James (an African American) to African American slaves? Also, since when did slaves get paid millions of dollars? How is that comparison even remotely relevant?
The comparison he made was of Gilbert to slave master mentality. He spoke using Gilbert's putative voice in this mind set. Jackson never compared James to a slave.
It's amusing, all the people complaining about Jackson for describing what another person is thinking, all the while proposing they know exactly what Jackson is thinking.