Sunan Abi Dawud, Book 2, Hadith 723 (Abu Dawud 1113)

Abu Hurairah reported the Messenger of Allah (ﷺ) as saying:

When you tell (your brother on Friday) to be silent while the imam is giving the sermon you are guilty of idle talk.