More Data Isn't Always the Answer

"We need more data."

It's one of the most common responses when people feel uncertain.

Sometimes it's the right response.

Often, it isn't.

If you're measuring the wrong thing, collecting more data simply gives you more confidence in the wrong conclusion. The real problem may not be the amount of data. It may be the question that produced it. 

I've seen this pattern in software development, mold investigations, product design, engineering, and even public policy.

People ask for another report.
Another dashboard.
Another survey.
Another test.

If the underlying question is flawed, every additional measurement reinforces the same mistake.

Before asking for more data, it's worth asking:

  • What problem are we actually trying to solve?
  • What assumption makes this measurement useful?
  • What would change if the data came back differently?
  • Are we measuring the right thing—or just measuring it more accurately?

Sometimes the biggest improvement isn't better data.

It's a better question.

Where have you seen organizations collect more data when the real problem was the question itself?

Leave a comment