The problem with big data, and yes, there are some, is many companies are storing data from different systems in different formats. This creates very large datasets that need to be integrated manually. What is the problem with that you say? Besides being time-consuming, it also creates an environment for potential errors. Whenever anything is manual, human error is a potential problem. DATAVERSITY brought us this interesting information in their article, “Weaving Your Own Big Data Fabric.”

This situation was the breeding ground for big data fabric. Evolving from information fabric that was developed through 2013, big data fabric is comprised of six layers: data ingestion, processing and persistence, orchestration, data discovery, data management and intelligence, and data access. Working together, these layers provide seamless, real-time integration of the data in a big data system, regardless of data silos.

Big data fabric offers many potential benefits for organizations including but not limited to effectively integrating big data assets with on-premises and cloud data sources, for a complete view of enterprise-wise information.

Melody K. Smith

Sponsored by Access Innovations, the world leader in thesaurus, ontology, and taxonomy creation and metadata application.