Hey neighbor...
While I really do enjoy your kids, I have to let you know that my insurance does NOT allow for anyone NOT enrolled in my child care to be on my property during business hours and on the weekends, it is my family time so I am unable to entertain your children during that time, I am sure you understand. Thank you for helping me follow all the laws.
That's how I would personally approach it.
