Big data is a hot buzzword of the past year or two and refers to high volumes of data being analysed often in near real time for actionable purposes. What makes big data different from good old data mining is the huge amount of data together with a high rate of change in the dataset and the wide variety of data types analysed.

 

 In addition to the very large amounts of data volumes to be stored, big data applications also demand real-time or near real-time responses. So big data storage demands high input/output operations per second (IOPS) performance. While pioneer big data practitioners such as Google, Facebook and Amazon employ hyperscale computing environments, for smaller businesses willing to take advantage of big data, there are more modest options. Unlike traditional data warehousing that mines relatively homogenous datasets, contemporary web analytics demands low-latency access to very large amounts of small files. Therefore, scale-out storage that consists of a number of compute and storage elements, where capacity and performance can be incrementally added, is among the most appropriate choices. When it comes to scalable analytics platforms, Hadoop is one of the most commonly used open-source platforms. In Hadoop, data is broken into smaller blocks and processed across nodes within the cluster. By means of its scale-out architecture, it is possible to cope with data analysis on a massive scale, even on many low-cost physical servers. Hadoop storage needs to support processing with the minimum latency possible.

 

 ·       Big data in Turkey

 

 Finding the right experts to help carry out analytics projects is a key challenge around big data in any part of the world, but more so in Turkey. Plus, because Turkey lags when it comes to implementing cloud architecture and related innovations, big data analytics have not really taken up to any significant extent.

 

 Even in the telecommunication and finance sectors, where state-of-the-art IT adoption in Turkey is at its most rapid, big data applications are yet to be implemented. That said, many institutions have deployed advanced enterprise data warehousing due to regulations that enforce detailed reporting. Fast-growing volumes of data and competitive business environments are expected to result in big data applications being in more demand soon. In the limited big data tools market in Turkey, Apache Hadoop is the leading product. Besides that, Cloudera and Hortonworks are the closest competitors. Oracle is also thriving to increase its share with its Big Data Appliance product.

Source: computerweekly.com