It was narrated from Ibn Umar:
The Prophet used to touch only the Stone and the Yemeni Corner. (Sahih) Chatper 157. Touching The Two Yemeni Corners