So it did that for me to and the only thing that made a difference was when I acctauly typed in my server name in the search. It worked some times needed to do twice but it worked for me
The best solution is one they actually came up with: you click on server but don't press join yet. Then switch to xbox settings>network settings> go offline. Wait 15 seconds then go back online. Return to ark and press join