Completely agree. There are so many additional layers of electrical costs (and other costs) not factored in
The build/infrastructure costs. Especially the early models before the A100 and datacenters jumped on the bandwagon.
Training costs of the model being used
Training costs of failed models and tests
Training costs of previous models that have been superseded before their cost could be recaptured from users.
The actual energy used by AI is likely orders of magnitude higher than estimated here, but without really justifying all the numbers used and sourcing them its going to be a never ending argument between the pro and anti-AI crowed with the realists stuck in between trying to read the data.
The build/infrastructure costs. Especially the early models before the A100 and datacenters jumped on the bandwagon.
Training costs of the model being used
Training costs of failed models and tests
Training costs of previous models that have been superseded before their cost could be recaptured from users.
The actual energy used by AI is likely orders of magnitude higher than estimated here, but without really justifying all the numbers used and sourcing them its going to be a never ending argument between the pro and anti-AI crowed with the realists stuck in between trying to read the data.