If Raffo was the head coach, Polk would still be around as a "volunteer assistant"- Raffo would only be the head coach in title only- the shots that he called would be limited at best.
Polk would let him recruit outside of the confines of the camp, but I think we would be about like Arkansas State right now- at best. And that's being optomistic since the SEC is so competitive.