Leaving After Lateral?

Lateraled from a solid group at a solid firm to a different group at an EB after about a year at my prior bank. Have been here about a month and long story short the group is not really as it was described in the interviews for it, and I think I can easily speak to the reasons why in an interview, but for sake of anonymity will just leave it at that.

The way I see it there are a few options: look to recruit for buyside gigs from here (should be possible albeit difficult), look to move to another IB, or attempt to return to my previous group (sounds impossible from the outside given I left after a year but may actually be possible). The purpose of this question is to know when it makes sense to do so. I'm nervous that doing this for too long will silo me further in this subsector that I don't want to be siloed in, but staying for too short of a time gives the appearance that I jump around too much and don't know what I really want. I'm prepared to give this group a chance still given I have not been here long so not trying to leave tomorrow or anything, but if a couple months go by and I know for a fact I don't want to be here still, can I begin to look into the other alternatives without damaging my career/reputation beyond this firm?