Data management has changed significantly over the past few decades. No longer do we migrate data from punch cards to tapes and magnetic discs. The rate of hardware innovation has vastly outpaced that of software and database systems in particular. This interesting topic came to our attention from Digital Insurance in their article, “4 components to a modern insurance data strategy.”
The fundamental characteristics of hardware have been revolutionized, yet database architecture has not, and it persists with structures that date back to a bygone era. Data remains virtually unusable in layer upon layer of systems, sprawling and disconnected. For some, analyzing and profiling data is like an archaeological dig.
The industry has largely focused on scaling hardware to overcome the performance deficiencies of databases rather resolve the fundamental hardware inefficiency.
Data architecture for big data and data lakes represents the current state for most organizations today as to what they are implementing or what they aspire to build. As we build toward this next level of data management maturity, it is important to look to the future.
Melody K. Smith
Sponsored by Data Harmony, a unit of Access Innovations, the world leader in indexing and making content findable.
