When I was in grad school I noticed that Gödel, Escher, Bach was the book about mathematics that non-mathematicians had on their coffee table. The one that the mathematicians had was The Mathematical Experience.

If I had to name only one other book, for this audience I'd have to go with Code Complete.