It was narrated from ‘Aishah that the Prophet (ﷺ) said:
“If a man stays among a people, he should not fast without their permission.”