Agile Data Management

From Glitchdata
Jump to navigation Jump to search

Concepts around Agile Data Management are:

  • Do not build monolithic data models
  • Do not wait until all available data and designs are available before starting
  • Use Web Services, and smaller quantums of data
  • Use Big Data platforms like Hadoop, Cassandra which facilitates lazy modelling
  • Expect dirty data
  • Build Data Quality principles around Pareto's rule