There's an incentive for chip vendors to not standardize since it makes migration hard and drives vendor lock-in. The CPU cores are one part but equally important is the peripherals and external featuresets.
That incentive might exist, but what really drives the lack of standardization is that every application has different needs, so you end up with a common CPU and wildly diverging configurations tailored to various applications.
