Leaving IB After 1 Year for Growing Fund

Long story short, started working in IBD as an analyst after getting a challenging  masters, now getting pinged by recruiters for near term opportunities.

Most of these are not particularly motivating - many are random, and I’m looking specifically to move into a PE fund investing the industry my job and masters degree cover. However, recently a new fund (~5 years old) reached out to me. They’re looking for an analyst to start in the fall; they have raised $1B this year and $1B last year. I’m very very interested in the space, but previously told myself I wouldn’t leave unless it were an increase in title (Associate) because it could damage my career credibility long term.

Is this perception accurate? Is leaving banking after a year totally damaging, or not that bad if the opportunity is good? It would be great to get into this opportunity early as there are now strong trends supporting the space, but it might be risky.

Also worth noting that my group has not been great with online learning. Looks good on paper but I’ve learned a lot less than expected and hours are brutal.