Point-to-Point and Barrier Synchronization in Distributed SPMD Systems

Simple item page
dc.contributor.advisorMellor-Crummey, John Men_US
dc.contributor.advisorSarkar, Viveken_US
dc.contributor.advisorBudimlić, Zoranen_US
dc.creatorMilakovic, Srdanen_US
dc.date.accessioned2019-11-11T14:12:15Zen_US
dc.date.available2020-06-01T05:01:08Zen_US
dc.date.created2019-12en_US
dc.date.issued2019-11-08en_US
dc.date.submittedDecember 2019en_US
dc.date.updated2019-11-11T14:12:16Zen_US
dc.description.abstractDistributed memory programming models are very often the only way to scale up large scientific applications. To ensure correctness and optimal performance in distributed applications, it is necessary to use general, high-level, but efficient synchronization constructs. Implementing distributed applications using one-sided communication libraries is getting more popular, as opposed to the two-sided communication used in the MPI model. However, in most cases, those libraries only have support for high-level collective barrier synchronization and low-level point-to-point synchronization. Phaser synchronization construct is a very attractive synchronization mechanism because it unifies collective and point-to-point synchronization in a simple, easy to use high-level synchronization construct. In this thesis, we propose several novel algorithms for phaser synchronization on distributed-memory systems with one-sided communication. We also present several improvements to the distributed barrier algorithms in the OpenSHMEM reference implementation. We establish a very high confidence level in algorithms' correctness by using the SPIN model checker for our algorithms. We evaluated our phaser algorithm using several benchmark applications on large supercomputers, and we show that using phasers can reduce the synchronization time by up to 47% and improve total execution time by up to 26%. This thesis shows that high-level, efficient, and intuitive synchronization is possible on distributed systems with one-sided communication.en_US
dc.embargo.terms2020-06-01en_US
dc.format.mimetypeapplication/pdfen_US
dc.identifier.citationMilakovic, Srdan. "Point-to-Point and Barrier Synchronization in Distributed SPMD Systems." (2019) Master’s Thesis, Rice University. <a href="https://hdl.handle.net/1911/107627">https://hdl.handle.net/1911/107627</a>.en_US
dc.identifier.urihttps://hdl.handle.net/1911/107627en_US
dc.language.isoengen_US
dc.rightsCopyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.en_US
dc.subjectDistributed phasersen_US
dc.subjectphasersen_US
dc.subjectOpenSHMEMen_US
dc.subjectOne-side communicationen_US
dc.subjectBarrier synchronizationen_US
dc.titlePoint-to-Point and Barrier Synchronization in Distributed SPMD Systemsen_US
dc.typeThesisen_US
dc.type.materialTexten_US
thesis.degree.departmentComputer Scienceen_US
thesis.degree.disciplineEngineeringen_US
thesis.degree.grantorRice Universityen_US
thesis.degree.levelMastersen_US
thesis.degree.nameMaster of Scienceen_US
Files
Original bundle
Now showing 1 - 1 of 1
Thumbnail Image
Name:
MILAKOVIC-DOCUMENT-2019.pdf
Size:
2.13 MB
Format:
Adobe Portable Document Format
Download
License bundle
Now showing 1 - 2 of 2
No Thumbnail Available
Name:
PROQUEST_LICENSE.txt
Size:
5.84 KB
Format:
Plain Text
Description:
Download
No Thumbnail Available
Name:
LICENSE.txt
Size:
2.61 KB
Format:
Plain Text
Description:
Download
Collections
Rice University Theses and Dissertations