I've learned the Register isn't a very good rag, they push the cattiness so much, you can only get information from between the lines. The reality is "AI" is an important part of the future, local AI if it's going to be a good future. The other reality is Apple is way ahead with its M chips for consumer devices, with their tremendous memory bandwidth and GPU well suited to running LLMs up to the speed of a 4080. If they didn't limit RAM so much and could scale up to the level of professional GPUs, they would be very compelling.
AMD is being very flaky with their rollout. They only provide the ML chip on some of their new chips, and let some vendors block it out in BIOS. I've been watching their github demo site, and they won't commit to anything but a very limited demo for Windows.
Intel at least released an open source kit earlier this year and will support their VPU on all Meteor Lake+ chips, as well as other processors. Consistency and openness is needed to break NVidia's deadlock here, OpenVINO could be a good step.
Meteor Lake will have 128GB/s for on-chip RAM bandwidth, that's a fraction of M-chips, it really remains to be seen how this will shake out, but it seems likely there will be a new class of computing device, and it may make all others very second class.
The cattiness is fine, because the validity of the use case doesn't mean their chips have a big enough advantage on that use case to matter. Not just because of all the vector units you already have in the CPU and iGPU cores, but as another comment points out memory bandwidth is often the bottleneck and a bunch of matrix multiply boosts won't affect that.
AMD is being very flaky with their rollout. They only provide the ML chip on some of their new chips, and let some vendors block it out in BIOS. I've been watching their github demo site, and they won't commit to anything but a very limited demo for Windows.
Intel at least released an open source kit earlier this year and will support their VPU on all Meteor Lake+ chips, as well as other processors. Consistency and openness is needed to break NVidia's deadlock here, OpenVINO could be a good step.
Meteor Lake will have 128GB/s for on-chip RAM bandwidth, that's a fraction of M-chips, it really remains to be seen how this will shake out, but it seems likely there will be a new class of computing device, and it may make all others very second class.