Sahih Muslim, Book 33, Hadith 258 (Muslim 4918)

Another version of the tradition narrated on the same authority worded slightly differently. It says:

(He) would not enter (upon his household at night).