Skip to content
Research Article Open access CC BY 4.0

A Comprehensive Survey for Hadoop Distributed File System

Karwan Jameel Merceedi, Nareen Abdulla Sabry

Asian Journal of Research in Computer Science · pp. 46–57 · Published 23 Aug 2021

10.9734/ajrcos/2021/v11i230260

Abstract

In the last few days, data and the internet have become increasingly growing, occurring in big data. For these problems, there are many software frameworks used to increase the performance of the distributed system. This software is used for available ample data storage. One of the most beneficial software frameworks used to utilize data in distributed systems is Hadoop. This software creates machine clustering and formatting the work between them. Hadoop consists of two major components: Hadoop Distributed File System (HDFS) and Map Reduce (MR). By Hadoop, we can process, count, and distribute each word in a large file and know the number of affecting for each of them. The HDFS is designed to effectively store and transmit colossal data sets to high-bandwidth user applications. The differences between this and other file systems provided are relevant. HDFS is intended for low-cost hardware and is exceptionally tolerant to defects. Thousands of computers in a vast cluster both have directly associated storage functions and user programmers. The resource scales with demand while being cost-effective in all sizes by distributing storage and calculation through numerous servers. Depending on the above characteristics of the HDFS, many researchers worked in this field trying to enhance the performance and efficiency of the addressed file system to be one of the most active cloud systems. This paper offers an adequate study to review the essential investigations as a trend beneficial for researchers wishing to operate in such a system. The basic ideas and features of the investigated experiments were taken into account to have a robust comparison, which simplifies the selection for future researchers in this subject. According to many authors, this paper will explain what Hadoop is and its architectures, how it works, and its performance analysis in a distributed systems. In addition, assessing each Writing and compare with each other.

Hadoop HDFS distributed file system

Cited by 32

Cross-Domain Data Processing based on Computer Technology and Big Data

Miao Chen, Zhenghui Zhao · 2025 International Conference on Intelligent Systems and Computational Networks (ICISCN) · 2025

Large-scale non-real-time Simulation Platform for Power Systems Based on Cloud Computing

Jing-Yue Zhang, Yuanhong Lu, Yu-Feng Hu · 2024 4th International Conference on Energy, Power and Electrical Engineering (EPEE) · 2024

Research on the Application of Big Data in Transient Stability Simulation of Power Systems

Jie Zhang, Haiping Guo, Yanjun Zhao · 2024 4th International Conference on Energy, Power and Electrical Engineering (EPEE) · 2024

Exploring the Use of Big Data in Financial Risk Management and Fraud Detection

V. Nivetha, A. Shameem, J. Suhashini · International Conferences on Contemporary Computing and Informatics · 2024

Research on Online Music Platform Recommendation Algorithm Based on Big Data Analysis Technology

Li Yang, Xi Yang · 2024 Second International Conference on Networks, Multimedia and Information Technology (NMITCON) · 2024

IDify - Distributed Database System for Digital Identification

Tishan Wickramasinghe, Chathraka Uvindusara Ranaweera, Viraj T Pathirage · Proceedings of Conference on Transdisciplinary Research in Engineering · 2024

Encryption Techniques for Hadoop Distributed File System (HDFS)

Anupam Mishra, Nitika Kapoor · 2023 5th International Conference on Advances in Computing, Communication Control and Networking (ICAC3N) · 2023

Article metrics

Real usage data collected on this platform.

0

Page views

0

PDF downloads

0

Outbound clicks

32

Citations

Views by country

Approximate, from request IP at view time — not citizenship or institution. Countries with fewer than 5 views are grouped as "Other".

No views recorded yet.

Traffic sources

Referring site, by host.

No traffic recorded yet.

Views and downloads exclude known bots/crawlers. Citations combines this platform's own DOI-resolved index with each external source's own reported total — see Cited by above for individually listed citing works. Last refreshed 0 seconds ago.