ENHANCING THE PERFORMANCE OF APACHE HADOOP IN MINING SORTING AND NORMALISING LARGE DATA SETS

Sahil Kapoor

Vol. 4, Jan-Dec 2018

Page Number: 102 - 108

Abstract:

Big knowledge refers to varied types of massive info sets that need special machine platforms so as to be analyzed. analysis on huge knowledge emerged within the Nineteen Seventies however has seen Associate in Nursing explosion of publications since 2008. The Apache Hadoop software system library primarily based framework offers permissions to distribute vast quantity of datasets process across clusters of computers mistreatment simple coder models. In this paper, we have a tendency to discuss the design of Hadoop, survey paper varied knowledge duplication placement methods Associate in Nursing propose Associate in Nursing approach for the advance of information replica placement and recommend an implementation of planned algorithmic rule with various Map scale back applications for rising performance of information in Hadoop clusters with relation to execution time and variety of nodes in Hadoop platform.

References

• Anton Spivak and Denis Nasonov “Data Preloading and Data Placement for MapReduce PerformanceInproving” Procedia Computer Science 101, 2016, Pages 379 – 387
• Mahesh Maurya, SunitaMahajan “Performance analysis of MapReduce Programs on Hadoop Cluster”IEEE World Congress on Information and Communication technologies,2012
• Ch. Bhaskar Vishnu Vardhan and Pallav Kumar Baruah, “Improving the Performance of HeterogeneousHadoop Cluster” Fourth International Conference on parallel, Distributed and Grid Computing (PDGC),2016
• Aseema Sultana “Unraveling the Data Structures of Big Data, the HDFS Architecture and Importance ofData Replication in HDFS” International Research Journal of Engineering and Technology (IRJET),Volume:05 Issue :01, Jan 2018
• DipayanDev, Ripon Patgiri “Performance Evaluation of HDFS in Big Data Management”, ICHPCA, 2014
• Patel Neha M, Patel Narendra M, Mosin I Hasan, Shah Parth D, Patel Mayur M, “Improving HDFS WritePerformance Using Efficient Replica Placement”, 5th International Conference – confluence The NextGeneration Information Technology Summit, 2014
• Richa Jain, AmitSaxena, Manish Manoriya, “Analysis of Dynamic Data Placement Strategy forHeterogeneous Hadoop Cluster”, International Journal of Emerging Trends and Technology in ComputerScience, Volume 4, Issue 4, July – Aug 2015

Back Download