Point-to-Point and Barrier Synchronization in Distributed SPMD Systems

Simple item page
dc.contributor.advisorMellor-Crummey, John M
dc.contributor.advisorSarkar, Vivek
dc.contributor.advisorBudimlić, Zoran
dc.creatorMilakovic, Srdan
dc.date.accessioned2019-11-11T14:12:15Z
dc.date.available2020-06-01T05:01:08Z
dc.date.created2019-12
dc.date.issued2019-11-08
dc.date.submittedDecember 2019
dc.date.updated2019-11-11T14:12:16Z
dc.description.abstractDistributed memory programming models are very often the only way to scale up large scientific applications. To ensure correctness and optimal performance in distributed applications, it is necessary to use general, high-level, but efficient synchronization constructs. Implementing distributed applications using one-sided communication libraries is getting more popular, as opposed to the two-sided communication used in the MPI model. However, in most cases, those libraries only have support for high-level collective barrier synchronization and low-level point-to-point synchronization. Phaser synchronization construct is a very attractive synchronization mechanism because it unifies collective and point-to-point synchronization in a simple, easy to use high-level synchronization construct. In this thesis, we propose several novel algorithms for phaser synchronization on distributed-memory systems with one-sided communication. We also present several improvements to the distributed barrier algorithms in the OpenSHMEM reference implementation. We establish a very high confidence level in algorithms' correctness by using the SPIN model checker for our algorithms. We evaluated our phaser algorithm using several benchmark applications on large supercomputers, and we show that using phasers can reduce the synchronization time by up to 47% and improve total execution time by up to 26%. This thesis shows that high-level, efficient, and intuitive synchronization is possible on distributed systems with one-sided communication.
dc.embargo.terms2020-06-01
dc.format.mimetypeapplication/pdf
dc.identifier.citationMilakovic, Srdan. "Point-to-Point and Barrier Synchronization in Distributed SPMD Systems." (2019) Master’s Thesis, Rice University. <a href="https://hdl.handle.net/1911/107627">https://hdl.handle.net/1911/107627</a>.
dc.identifier.urihttps://hdl.handle.net/1911/107627
dc.language.isoeng
dc.rightsCopyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.
dc.subjectDistributed phasers
dc.subjectphasers
dc.subjectOpenSHMEM
dc.subjectOne-side communication
dc.subjectBarrier synchronization
dc.titlePoint-to-Point and Barrier Synchronization in Distributed SPMD Systems
dc.typeThesis
dc.type.materialText
thesis.degree.departmentComputer Science
thesis.degree.disciplineEngineering
thesis.degree.grantorRice University
thesis.degree.levelMasters
thesis.degree.nameMaster of Science
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
MILAKOVIC-DOCUMENT-2019.pdf
Size:
2.13 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
PROQUEST_LICENSE.txt
Size:
5.84 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
LICENSE.txt
Size:
2.61 KB
Format:
Plain Text
Description:
Download
Collections
Rice University Electronic Theses and Dissertations