A Study on Efficient Executions of MPI Parallel Programs in Memory-Centric Computer Architecture (메모리 중심 컴퓨터 구조에서 MPI 병렬 프로그램의 효율적인 수행에 관한 연구)

Je-Man Lee (이제만); Seung-Chul Lee (이승철); Shin Dong Ha (신동하)

doi:10.9708/jksci.2020.25.01.001

A Study on Efficient Executions of MPI Parallel Programs in Memory-Centric Computer Architecture

Journal of The Korea Society of Computer and Information
Abbr : JKSCI
2020, 25(1), pp.1-11
DOI : 10.9708/jksci.2020.25.01.001
Publisher : The Korean Society Of Computer And Information
Research Area : Engineering > Computer Science
Received : September 30, 2019
Accepted : November 25, 2019
Published : January 31, 2020

Je-Man Lee ¹, Seung-Chul Lee ¹, Shin Dong Ha ¹

¹상명대학교

Accredited

ABSTRACT

In this paper, we present a technique that executes MPI parallel programs, that are developed on processor-centric computer architecture, more efficiently on memory-centric computer architecture without program modification. The technique we present here improves performance by replacing low-speed data communication over the network of MPI library functions with high-speed data communication using the property called fast large shared memory of memory-centric computer architecture. The technique we present in the paper is implemented in two programs. The first program is a modified MPI library called MC-MPI-LIB that runs MPI parallel programs more efficiently on memory-centric computer architecture preserving the semantics of MPI library functions. The second program is a simulation program called MC-MPI-SIM that simulates the performance of memory-centric computer architecture on processor-centric computer architecture. We developed and tested the programs on distributed systems environment deployed on Docker based virtualization. We analyzed the performance of several MPI parallel programs and showed that we achieved better performance on memory-centric computer architecture. Especially we could see very high performance on the MPI parallel programs with high communication overhead.

KEYWORDS

Computer Architecture, Memory-centric Computer Architecture, Parallel Programming, MPI, Simulation

Citation status

* References for papers published after 2023 are currently being built.

[confproc] P. Faraboschi / 2015 / Beyond processor-centric operating systems / Proceedings of the 15th USENIX conference on Hot Topics in Operating Systems : 17~17

[other] K. Keeton / 2017 / Memory-Driven Computing / Keynote at USENIX FAST

[journal] K. M. Bresniker / 2015 / Adapting to thrive in a new economy of memory abundance / Computer 48(12) : 44~53

[confproc] D. Efnusheva / 2015 / A Novel Memory-centric Architecture and Organization of Processors and Computres / International Conference on Applied Innovations in IT 3(1) : 47~53

[book] A. Grama / 2003 / Introduction to Parallel Computing / Addison Wesley

[book] W. Gropp / 2014 / Using MPI Portable Parallel Programming with the Message-Passing Interface / The MIT Press

[web] / MPI Forum / https://www.mpi-forum.org

[confproc] M. T. Chung / 2016 / Using Docker in High Performance Computing Applications / IEEE International Conference on Communications and Electronics : 52~57

[web] / Docker Documentation / https://docs.docker.com

[book] K. Matthias / 2015 / Docker: Up and Running / O'Reilly

[book] G. Hager / 2010 / Introduction to High Performance Computing for Scientists and Engineers / CRC Press

[journal] K. Takeuchi / 2016 / Memory system architecture for the data centric computing / Japanese Journal of Applied Physics 55(4S) : 04EA02~

[confproc] J. McCalpin / 2016 / Memory Bandwidth and System Balance in HPC Systems / ACM/IEEE Supercomputing Conference

[web] / The Machine / https://www.labs.hpe.com/memory-driven-computing

[journal] A. Degomme / 2017 / Simulating MPI Applications : The SMPI Approach / IEEE Transactions on Parallel and Distributed Systems 28(8) : 2387~2400

[confproc] T. Hoefler / 2010 / LogGOPSim–Simulating Large-Scale Applications in the LogGOPS Model / Proceedings of the 19th ACM International Symposium on High Performance Distributed Computing : 597~604

[journal] C. Janssen / 2010 / A Simulator for Large-scale Parallel Computer Architectures / International Journal of Distributed Systems and Technologies 1(2) : 57~73

[confproc] Je-Man Lee / 2019 / Efficient Executions of MPI Parallel Programs in Memory-Centric Computer Architecture / Proceedings of The Korea Society of Computer and Information Summer Conference 27(2) : 257~258

This paper was written with support from the National Research Foundation of Korea.

KJCKorea
Journal Central

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

A Study on Efficient Executions of MPI Parallel Programs in Memory-Centric Computer Architecture

ABSTRACT

KEYWORDS

Citation status

* References for papers published after 2023 are currently being built.

Journal of The Korea Society of Computer and Information 2023 KCI Impact Factor : 0.65

A Study on Efficient Executions of MPI Parallel Programs in Memory-Centric Computer Architecture

ABSTRACT

KEYWORDS

Statistics

Tools

Issue List

Citation status

KCI Citation Counts (0)

REFERENCES (18) * References for papers published after 2023 are currently being built.

Search PDF

Citation

* References for papers published after 2023 are currently being built.