Would it be stupid to look to leave my current role?

Current an1 at a small boutique IB (less than 20 person shop), been on the desk for a few months now. Staffed on a few deals and work maybe only 45-55 hours a week on average, and rarely do weekend work. Not in a major financial hub, but my bank pulled a few guys from larger IBs.

Always have known that I want to get to NYC to work for a large bank. Had an internship last summer at a large MM but unfortunately didn’t get a return offer. I’ve been doing a lot of networking calls since I have a lot of spare time. Was talking to a friend who told me it’d be stupid to leave given hours I work and comp which is pretty in line if not above average for a bank of this size.

Would love to hear thoughts on anybody who’s been in a similar boat with going from a small boutique IB to a larger one.