Author(s)

Liu Yongjin ¹

Affiliation(s)

¹ Xihua University, Chengdu, Sichuan, China

Corresponding Author

Liu Yongjin

ABSTRACT

With the rapid development of cloud computing technology, large-scale data processing systems are facing unprecedented challenges and opportunities. This paper delves into the key technologies and strategies for constructing and optimizing large-scale data processing systems in a cloud computing environment. Firstly, the paper analyzes the characteristics of the cloud computing environment and its intrinsic connection with big data processing, clarifying the system design requirements. Subsequently, a comprehensive architecture design scheme is proposed, which combines distributed computing frameworks, efficient data storage and management strategies, and optimized network architectures. In terms of system optimization, the paper starts from four dimensions: performance, cost, scalability, and security, and proposes a series of targeted optimization measures, including resource scheduling optimization, cost-benefit analysis, modular design, and data security strategies. Through case analysis, the effectiveness of the proposed architecture design and optimization strategies has been validated. The research results of this paper not only provide theoretical guidance for large-scale data processing systems in cloud computing environments but also offer valuable references for practical applications in related fields.

KEYWORDS

Cloud Computing; Large-scale Data Processing; System Architecture; Performance Optimization; Cost-effectiveness

CITE THIS PAPER

Liu Yongjin, Architecture Design and Optimization of Large-scale Data Processing Systems in Cloud Computing Environments. Advances in Computer, Signals and Systems (2024) Vol. 8: 91-96. DOI: http://dx.doi.org/10.23977/acss.2024.080313.

REFERENCES

[1] Zhou, G. Q. (2023). Research on large-scale data processing technology in cloud computing environment. Information and Computer (Theoretical Edition), 35(15), 70-72.
[2] Liu, P. (2021). Research on large-scale graph data processing technology in cloud computing environment. Electronic World, (19), 37-38. DOI: 10.19353/j.cnki.dzsj.2021.19.017.
[3] Zhang, J. W. (2020). On the computer processing technology of large-scale data. Scientific and Technological Innovation, (08), 66-67.
[4] Bai, Y. L. (2013). Research on large-scale data processing in cloud computing environment. Software, 34(05), 128-129.

Sponsors, Associates, and Links

---

• Power Systems Computation
  
  
• Internet of Things (IoT) and Engineering Applications
  
  
• Computing, Performance and Communication Systems
  
  
• Journal of Artificial Intelligence Practice
  
  
• Journal of Network Computing and Applications
  
  
• Journal of Web Systems and Applications
  
  
• Journal of Electrotechnology, Electrical Engineering and Management
  
  
• Journal of Wireless Sensors and Sensor Networks
  
  
• Journal of Image Processing Theory and Applications
  
  
• Mobile Computing and Networking
  
  
• Vehicle Power and Propulsion
  
  
• Frontiers in Computer Vision and Pattern Recognition
  
  
• Knowledge Discovery and Data Mining Letters
  
  
• Big Data Analysis and Cloud Computing
  
  
• Electrical Insulation and Dielectrics
  
  
• Crypto and Information Security
  
  
• Journal of Neural Information Processing
  
  
• Collaborative and Social Computing
  
  
• International Journal of Network and Communication Technology
  
  
• File and Storage Technologies
  
  
• Frontiers in Genetic and Evolutionary Computation
  
  
• Optical Network Design and Modeling
  
  
• Journal of Virtual Reality and Artificial Intelligence
  
  
• Natural Language Processing and Speech Recognition
  
  
• Journal of High-Voltage
  
  
• Programming Languages and Operating Systems
  
  
• Visual Communications and Image Processing
  
  
• Journal of Systems Analysis and Integration
  
  
• Knowledge Representation and Automated Reasoning
  
  
• Review of Information Display Techniques
  
  
• Data and Knowledge Engineering
  
  
• Journal of Database Systems
  
  
• Journal of Cluster and Grid Computing
  
  
• Cloud and Service-Oriented Computing
  
  
• Journal of Networking, Architecture and Storage
  
  
• Journal of Software Engineering and Metrics
  
  
• Visualization Techniques
  
  
• Journal of Parallel and Distributed Processing
  
  
• Journal of Modeling, Analysis and Simulation
  
  
• Journal of Privacy, Trust and Security
  
  
• Journal of Cognitive Informatics and Cognitive Computing
  
  
• Lecture Notes on Wireless Networks and Communications
  
  
• International Journal of Computer and Communications Security
  
  
• Journal of Multimedia Techniques
  
  
• Automation and Machine Learning
  
  
• Computational Linguistics Letters
  
  
• Journal of Computer Architecture and Design
  
  
• Journal of Ubiquitous and Future Networks