Persecution comes when Christianity is not dominant in a society or nation. Religious people who are not InChrist will persecute true believers the hardest. It was religious people who brought Jesus before Pilate and Herod.
Notice that Jesus says that our persecution and prosecution will be used as a testimony against them. This indicates that Christ takes rejection of the Gospel very seriously.