In my humble and honest opinion, I think things went down hill after Kye Kelly refused to pay John Doe(Scott Tayler) after a few high dollar races he lost. In the world of grudge you cant decline paying someone money and expect to get a hall pass. I think, and this is just my memory and piecing the timeline together he started to get shunned after that. Nobody wants to invite someone to race for money if they know he wont pay.