Would you leave banking for this opportunity?

I may have the opportunity to join a mid sized company in a general management role with P&L responsibility. In essence I’d be running a smaller division of a ~$2 billion revenue company. It’s not a huge division roughly $30-50mm in revenue but I’d have substantial responsibility and flexibility to run it. It’s about 10 direct reports and another 150 indirect reports. Pay is probably anywhere from flat to what I currently make all in to 10-2% higher. The firm is stable, modestly acquisitive, but barring any promotions I’ll be getting 4% annual raises indefinitely. Currently I’m reasonably happy at my firm, lifestyle isn’t bad by banking standards and obviously compensation growth prospects are a bit better.

My thought is if I go and spend a few years as an operator I’ll either love it and move up or gain a valuable skillset and I don’t think I’m giving up much optionally, but I’m interested to hear other people’s opinions.