Thinking of switching from IB to a boutique firm

I'm currently a first year IB associate at a big four bank working in commerical real estate. My team covers a lot of asset types (all real estate and even gaming companies, homebuilders, cruiselines). I really like asset level financing (CMBS loans). My team is currently driving me insane, senior leaders are incompetent they even just promoted someone that every single person filed complaints about. I feel like the juniors on my team, myself included, are running the entire team. Working at a big bank provides me security in the job, but its become more about appeasing regulators and other teams rather than the deals. I'm considering the switch to a smaller, more boutique company maybe even outside of IB (maybe developer firm, investment firm, etc) that would allow me to have more of an impact in the company and the clients. Any advice from others on exiting BB IB for something smaller?