Lifetime banker: Cost of temporarily switching countries?

I am currently a first year analyst at a Canadian investment bank. I completed a couple of lengthy internships prior to my current stint, and I must say that although there are many cons of banking, I genuinely find interest in the work I perform day-to-day and I am fascinated by the work carried out by the more senior bankers. Given my interests and skillset, I have set my goal on becoming a lifetime banker.

Through my relationships I have the been given the opportunity to lateral to an EB in NYC. This EB's dealflow crushes my current bank's dealflow, which I feel is valuable given that greater deal exposure should allow me to develop more technical skills, or at least develop technical skills faster - a valuable proposition given my career goals. However, I would eventually like to move back to Canada. Thus, my question is: Would moving to the US for a couple more years of analyst work or potentially associate work, only to return back to Canada, hinder my ability to climb the ranks back in Canada? I feel like losing out on building/creating relationships in Canada by moving to the US would create a disadvantage for a lifetime banker.

For example, my route could look like: Year 1: Analyst at Canadian bank Year 2-4: Analyst at an EB in the US Year 5+: Return to Canada and climb the ranks

TL;DR --> Assuming I eventually move back to Canada, would the technical skills gained by moving to a bank in the US outweigh the opportunity cost of missing out on building relationships in Canada?

I'd appreciate any thoughts on this. Thanks.