From hedge fund/asset management BackOffice to investment analyst at a Broker(think CBRE..ish)...to R-Estate investment(Buyside)

Hello,
I'm actually a back office analyst at a top hedge fund/Asset Management firm (think 50B+++)...I'm done with my MSF and waiting for the CFA L3 results...+ I had a few internships in real estate investments (which I really liked)..

Sadly, I've seen barely no transfer to front office in my firm....where they only hire extremely experienced people...probably because the firm is so popular...

I thought of going back in Real Estate investments...or at least a deal oriented environment (PE or Infrastructure maybe)...I recently got an offer at a good real estate broker..where I would mostly do CIMs and asset valuation..which looks good but I'm scared of being tagged as a "Broker" and not being able to transfer to a real estate investment/asset management firm..or hedge fund specialized in R-Estate.
Does the broker "tag" hurts ..does it exist?

I was thinking that at least this switch would teach me a little more..than my routine in the Back office (2 years)...

What do you guys think ?

Thanks in advance,