Big Data, Small Data, what’s the difference? Volume. From an Information Governance perspective, Big Data needs to be managed by the same principles and processes as any other data, the only difference is volume. Records, information, and data produced or processed by an organization have to be managed in a consistent manner regardless of the media or the size or volumes of the records. Information must be managed in a compliant manner for its entire lifecycle and either be produced or evidence of disposition produced when required. Big Data is a concept being bandied about the marketplace with a focus on enterprise search and data mining for developing useful business intelligence and harvesting value inherent in an organization’s data store. From an Information Governance perspective, all data needs to be managed in a manner consistent with rules, regulations, and business requirements and needs to be applied consistently across data repositories and processes and activities need to be documented and audited for compliance.
In my opinion, Big Data is an IT buzz word attempting to create demand for enterprise search products and services to enable organizations to process large amounts of real time data and information. There is nothing really new here from the perspective of Information Governance or Records Management. This data will have some value to the organization and will have to be classified, managed, retained, and disposed of according to Information Governance principles, same as the rest of the data, information, and records of an organization. The difference is volume, but we already knew that. Here's more on Information Governance and Archive Systems' Strategic Consulting Services.
VP of Information Governance at Archive Systems