Talk to your husband, tell him exactly what the boundaries for FIL need to be and why. Then let your DH deal with his father.

Reply