Jami` at-Tirmidhi, Book 33, Hadith 99 (Tirmidhi 2324)
It was narrated from Ibn 'Abbas, that the Prophet(s.a.w) said:
"Whoever resides in the deserts, he becomes ignorant, whoever follows game, he becomes heedless, and whoever comes to the door of the Sultan, he will suffer a Fitnah."