The most common limiting factor is not your physical ability, but your mental ability.
The ability to follow through on the monotonous daily obligations of sticking to a routine and remaining consistent is far more challenging than any training session I have ever hit. The ability to forget about the now and focus on the end goal while simultaneously being able to block out the end goal and focus on the single step in front of you is something it takes most of us years to reach. But that's just it. Everyday that you "practice" you progress. Practice makes progression not perfection.
You can always better your best through practice. Practice consistency. Practice reinforcing your boundaries and stick to them.
Everyday you do this it becomes easier and easier. Consistency is the foundation for success.