AM to Banking...The Big Jump

Everyone,
Been working in S&T/AM for several years now, and really enjoy it. I've been testing the waters and have a (very) good shot at an IB position. A friend of mine knew I was looking, and currently works at the firm, so he offered to pass along my resume. I never even expected a phone call back, because S&T isn't IB, and IB isn't S&T. Fastforward to now.... I have gone through the motions; case study, technical review, informational, behavioral, etc. and they still like me. It's in a new city where I don't know anyone, and it's a new industry that I don't know if I'll even enjoy. The money will definitely be better, but i'll be working more hours. Would I be crazy to not take this offer if it comes my way? Is it worth jumping to a new career path for prestige and money, when you enjoy the one you're on?