The High Performance Podcast host said 'don’t ask ordinary communities to quietly pay the price for it'