You may want to amend your original statement "Of course we can. Everybody that isn't somehow colorblind can reliably distinguish between a basic number of colors [...]" then, because clearly that's not the case as you state yourself.