Going buyside: Does location matter?

Would you advise someone (late 20s, 3rd year Analyst / 1st year Associate) to take a potentially career-track opp at a buy side firm in a different city with the hope of leveraging that experience to move to an NYC position later on? Does making it to the buy side in any capacity outweigh location considerations? How difficult is it in practice to make such a move?