I realize this is probably a joke, but the relative infrequency of rating, the fact that this rating algorithm only requires information from the local context[1], and the existence of caching means that this is very, very unlikely to be the bottleneck for any site.
[1] i.e. to calculate Harry Potter's rating you only need to know about Harry Potter, not every other book ever printed
[1] i.e. to calculate Harry Potter's rating you only need to know about Harry Potter, not every other book ever printed