I do not remember Jesus every saying to anyone that He would have nothing more to do with them, as far as I can remember the only time Jesus was ever mad was over money and the religious leaders of the time. It was the religious leaders that had all the problems, nothing has changed in 2000 years.