Feasibility of Coming Back to Finance

Have an opportunity at a really interesting company for a finance and operations position that I'm thinking of pursuing. Not interested in going down the PE route and I like the transaction work in banking but my group's culture has been very tough in terms of personalities that is really affecting my liking for the actual work itself. Have thought about lateraling banks but obviously that is difficult in the current environment. If I leave IB for a "non high-finance" role after a year to try out something different like this, would I be shutting the door on banking permanently or would I still be eligible for lateral analyst positions down the line (assuming lateral markets open up at some point) by having a year of banking experience? At an EB currently so would it mostly be possible by willing to go downstream to come back? Otherwise can just try to stick it out here but would not want to be here long term either way which is why I've been considering this option.