"One weird trick" is still pretty much the first way to go for most recommendation systems that are large embeddings focused. see torchrec, nvidia's hugectr
the thing is humans have most efficiently encoded (in detail) reality in text. humans already highlight what is worth encoding about reality.
for example, you can finetune gpt-2 to have an idea of sexual biology by having it read erotica. just like how you can have a model learn the same by watching porn. but it is much more efficient to read the text, since there is much less information that is "useless"
Oh please, AGNB isn't in the same league as Louis Theroux. It's a great YouTube channel and they do a good job of making fools look foolish, but to compare it to Theroux's work is absurd.
It's too late to edit my previous comment, but I did think of one thing to add: 5G allows for more efficient use of spectrum, which benefits everyone. (Although, it benefits the carriers the most.)
So, while I don't think it's worth waiting for, I do think it is a good thing overall.