Prime minister Keir Starmer first pledged to clear a path through planning restrictions well before he won his current job.