PE to VC Crazy in this Market?

I'm currently a 2nd year associate at a growing MM firm on the west coast and am getting approached with opportunities from HH for top VC firms, among other roles. I certainly like my firm, specific team, and there's opportunity to move up to Sr. Associate and VP if I continue to perform. I could see myself in PE long-term and my firm prioritizes WLB but after working on numerous transactions, the work is fairly repetitive and cut and dry post-IOI. There's still a lot for me to learn but I have also always found the series a to late stage venture space interesting. Would it be crazy to make a move to one of the more established names in the VC space right now (i.e., IVP, General Catalyst, Accel, DFJ, NEA type of names)?