You will face problems either way. I prefer to follow the Holy Spirit. You will always abstain yourself from one or the other. This is the clue for holiness, it’s not a condition you live in, but a decision you make every moment, every day
Make sure to forget about your past, but not about the benefits you have today. It is God who heals you, rescues you, lifts you up, and crowns you. He will satisfy us with good, don’t forget any of his benefits.