Not one senior party figure originally thought he had a prayer of leading them back into government in a single parliament, but now he bestrides a transformed political landscape