IB to CFO to Investor?

After c. 9 years in IB (UK), I am looking to make a career move. I had two tracks in mind - CFO or Investor.
I have an offer for a CFO role in a fairly mature SaaS startup (T-2 for exit, no more funding needed) which seems a good fit. I am also speaking to a few mid-market and growth funds and am confident I can get an offer. I am leaning to the CFO role as it was more difficult to get this one and seems like a rare opportunity without any operating experience. 
If I end up hating it, will it be more or less difficult to go down the investor route (mid-market or growth tech fund)? I am looking to come in at VP level, not senior assoc.