Big Data

754 Words2 Pages

Big Data in recent years is a term that has become crucial to how we manage, store and analyse the data we collect. Currently “Big Data” trends can trace their roots to a definition Kant first devised in the eighteenth century. Kant drew a comparison between analytic and synthetic truths. It’s important to understand this comparison in order to gain an understanding of the shift in analytics. It is only when we understand this shift can we begin to appreciate the changes that organisations and governments are making to solve the problems of tomorrow.

An analytic truth is a truth which can be derived from a logical argument. For example, when we consider the rules of arithmetic we can state that “2+2=4”. Whereas on the other hand a synthetic truth, is a statement whose correctness could not be determined without access to pre-obtained evidence/data. Without this data, we can’t reason that adding ten new links to a webpage will increase the number of daily visitors by 41%. Therefore, with the rise in big data and the increase of programmatic interfaces to new industries there has been a shift in the methods by which problems are being solved. Fundamentally, we are currently making the transition from creating novel analytic models and deducing new findings, to creating the infrastructure and capabilities to solve the same problems through a synthetic approach. Until recently, we used analytical reasoning to drive scientific and technological advancements. Our emphasis was either, the creation of new models or using existing models to derive new statements. The reason the analytical approach was used for so long was because it was the method of analysising data in other disciplines. However, due to the sheer amount of data which i...

... middle of paper ...

...ng structures, we no longer rely on step function driven analytical insights. Instead we are seeing widespread adoption of a synthetic infrastructure to accelerate the synthetic problem solving method. Traditionally these techniques were constrained to artificial intelligence and information retrieval but as we digitise new data sets and build necessary automation on top of them, we can employ synthetic application in new industries. It is often said that, “Software is taking over the world”. However, as we investigate and understand the nature of software better, we begin to understand that it’s not only software, but instead software combined with digital data sets and automated input/output mechanisms that will dominate the world of computing as automation, data science and software unite to transform our problem solving capabilities – from analytic to synthetic.

More about Big Data

Open Document