The problem is "no deal" (which is what "just leave" really means) isn't a destination, but a waypoint on the path towards a destination. We will still have to renegotiate all our treaties and trade agreements with the EU once we've left. And all the ones with the rest of the world we had by virtue of being an EU member. So Brexit won't be over for years or decades. One thing will change: we can't stay, because we'll already be out. So the notion of "Remain" goes away, presumably swiftly replaced by "Re-enter".
But please don't make the mistake of assuming that leaving ends Brexit. I know, I know, loads of politicians keep saying it will. But when you think about it for 30 seconds, that's impossible. We can't survive as a nation without connections to the global order - that would make us on a par with North Korea. So the process of rebuilding all of those is what will take time, lots of time. Until we've picked ourselves back up off the ground and found our feet again, Brexit continues. And our politicians will continue to be sidetracked by it (arguing over what future relationship to have) rather than concentrating on what they should be concentrating on: the NHS, mental health, policing, improving educational outcomes, tackling homelessness etc. etc. Basically, all the stuff that's been sidelined for 3 years will go on being sidelined.