You can get a 1TB of HBM2 vram for like 10k, https://www.ebay.com/itm/177571378959

The problem is the backplane I have not managed to find a single baseboard, and getting a random baseboard to work with random modules is probably a crap shoot.