I don't think so OP.
If he knows you are married, then he is under the assumption that you are going to bring your wife and kids to the event because he has mentioned his wife and kid. It isn't "date my daughter", but more so "my daughter is around your wife and your age so it wouldn't be too weird".
I personally would never visit the house of a boss/co-worker. It blurs the lines and they normally use these dinners as a way of getting more information about your life than you would normally share.
If he knows you are married, then he is under the assumption that you are going to bring your wife and kids to the event because he has mentioned his wife and kid. It isn't "date my daughter", but more so "my daughter is around your wife and your age so it wouldn't be too weird".
I personally would never visit the house of a boss/co-worker. It blurs the lines and they normally use these dinners as a way of getting more information about your life than you would normally share.