Sahih Muslim, Book 33, Hadith 4 (Muslim 4664)

It has been narrated on the authority of 'Abdullah that the Messenger of Allah (ﷺ) said:

The Caliphate will remain among the Quraish even if only two persons are left (on the earth),