Next move after 2+2 | Going back to IBD?

Background: I just finished my first associate year at an UMM PE firm and was previously at a top BB IB group (think GS / MS / JPM). However, don't think I will be able to stay past my second associate year. Not interested in B school. 

By end of second PE year, should have ~$400-500K in liquid savings. Have serious girlfriend + want to buy house + have kids early, so contemplating going back to IB as a senior associate (maybe VP?) to get high cash comp short-term. Would stay for ~3 years, target ~$1M net worth by age 29, then exit to corporate (strategic finance / corp dev), buy house in suburbs, & have first kid. 

Am thinking of targeting IB given how tough the buyside recruiting market is + higher cash comp. 

That said, I am wondering how bad IB hours are at the senior associate / VP level and what the cash comp looks like these days. I remember getting absolutely grinded (consistent 2-3 am nights + weekend work) as an IB analyst but not sure if this is the norm for more "normal" groups at the mid-level. 

For context, also been working on a side business with a few partners, so ideally want to be able to spend ~5-10 hours on it per week. 

Thanks a lot!