Untested idea: Do regular user surveys asking, "how reliable is the product?" This would provide a measure of how buggy the software is that can be tracked over time.