Was it a bad idea to ask him to sleep over at his house?

It's a terrible idea. Sex should be reserved for marriage or, at the very least, a committed relationship and you are in neither. You've only been dating a few months.