They can do it any time they want to. At trumps age he'll never make it through his term and they'll just wind up having to 25th him.
Gotta tip your hat to Joe's masterful move of waiting until after the conk convention to withdraw. An enormous waste of time and effort and money attacking somebody you aren't running against.