Meditation not linear

I've heard it said that meditation is not a linear path and that every time you sit is like the first time but that you get better at sitting for the first time. If this is the case and you don't actually make gains in a linear way then can it also be said that if you stop doing it that you will not go backwards or lose what you have learnt because you didn't go anywhere to begin with?