You're attacking video games and the like a bit, but the core of your argument is sound I think - there's 24 hours in a day, a percentage will be spent on taking care of your needs, what percentage that is depends on various factors but most anthropologists agree that that number was much lower in ancient civilizations. People get bored and when they get bored they get creative. Polishing a rock would be one of the things they could end up doing.