Traveling during weekend with 5 day in-office policy

I am unfortunately going to be in a newly long-distance relationship due to starting my analyst stint at a BB with a 5-day in-office policy. Is it doable for me to occasionally leave town saturday and sunday to go visit my SO? The flight is about 4 hours each way and I figure I would WFH on Sunday and take a redeye flight back home. Obviously I wouldn’t do this in the first few months, but looking ahead to when I am more settled in.

If this really wouldn’t work, I would try to just go on Saturdays (one day trips). Luckily my SO has agreed to come see me much more often than the other way around but I would feel bad if I didn’t travel to them at all.

And I am assuming the long distance relationship situation is something I should not bring up to my manager and I should just do whatever I’m going to do travel wise

Either way wish me luck haha