Banks Worth It for Lawyer Lateral Associate Move

I’m curious which banks people consider worth it to switch to for a early career attorney making ~$350k.  I’m essentially looking at IB positions at the Associate level, and it seems like most banks are hiring right now. Probably looking at something like special situations, leveraged finance, etc. I assume it’s worth it to switch to associate job at something like JP Morgan, but would it be worth it to switch to something like Raymond James or Stifel, especially in a more niche group.  Trying to feel out how difficult it is to excel at the lateral Associate position.  For mid-career Associate laterals, do boutiques and middle-market reliably offer that path to $1million+ careers in PE, banking, etc. (especially from smaller cities like Baltimore)?  Or are you going to be stuck in small banks making $500kish money?  How many years are these Associates generally staying at the banks?