Big Data Storage and Decentralization: A Review

In this data-driven era, when the number of devices connected to the Internet is growing at a rapid rate, effective storage of Big Data is still an open challenge. The quantity of data generated by social media platforms, e-commerce platforms, the telecom sector, and online businesses are huge. With the rise of the Internet of Things technology, there is a significant increase in devices connected to the internet that has exposed challenges related to the storage and management of the data. Organizations and corporate seeks to extract knowledge out of the data generated. The process of knowledge discovery involves the processing of data and it becomes a challenge when the amount of data is huge. Big Data Technologies helps to provide a framework to deal with it. Frameworks like Hadoop Distributed File System are efficient when it comes to the storage of Big Data. With this rapid development, the corporates prefer NoSQL Databases to handle the real-time quantity of such data. This paper aims to explore Big Data Storage technologies and one peer to peer file system IPFS to analyze adaptability and suitability for big data storage.