There have been a lot of news stories lately of providers doing shady things to attempt to force naps.
Tying kids up, leaving them unsupervised behind closed doors, strapping them in unsafe confinement equipment, drugging them etc.
I would not take it personally.
If it happened again I'd just ask what his concerns were to open discussion.