Elastic Tasks: Unifying Task Parallelism and SPMD Parallelism with an Adaptive Runtime
| dc.contributor.author | Agrawal, Kunal | |
| dc.contributor.author | Sarkar, Vivek | |
| dc.contributor.author | Sbîrlea, Alina | |
| dc.date.accessioned | 2017-08-02T22:03:16Z | |
| dc.date.available | 2017-08-02T22:03:16Z | |
| dc.date.issued | 2015-02-11 | |
| dc.date.note | February 11, 2015 | |
| dc.description.abstract | In this paper, we introduce elastic tasks, a new high-level parallel programming primitive that can be used to unify task parallelism and SPMD parallelism in a common adaptive scheduling framework. Elastic tasks are internally parallel tasks and can run on a single worker or expand to take over multiple workers. An elastic task can be an ordinary task or an SPMD region that must be executed by one or more workers simultaneously, in a tightly coupled manner. The gains obtained by using elastic tasks, as demonstrated in this paper, are three-fold: (1) they offer theoretical guarantees: given a computation with work W and span S executing on P cores, a work-sharing runtime guarantees a completion time of O(W/P+S+E), and a work-stealing runtime completes the computation in expected time O(W/P + S + E lgP), where E is the number of elastic tasks in the computation, (2) they offer performance benefits in practice by co-scheduling tightly coupled parallel/SPMD subcomputations within a single elastic task, and (3) they can adapt at runtime to the state of the application and work-load of the machine. We also introduce ElastiJ — a runtime system that includes work-sharing and work-stealing scheduling algorithms to support computations with regular and elastic tasks. This scheduler dynamically decides the allocation for each elastic task in a non-centralized manner, and provides close to asymptotically optimal running times for computations that use elastic tasks. We have created an implementation of ElastiJ and present experimental results showing that elastic tasks provide the aforementioned benefits. We also make study on the sensitivity of elastic tasks to the theoretical assumptions and the user parameters. | |
| dc.format.extent | 29 pp | |
| dc.identifier.citation | Agrawal, Kunal, Sarkar, Vivek and Sb�rlea, Alina. "Elastic Tasks: Unifying Task Parallelism and SPMD Parallelism with an Adaptive Runtime." (2015) https://hdl.handle.net/1911/96416. | |
| dc.identifier.digital | TR15-02 | |
| dc.identifier.uri | https://hdl.handle.net/1911/96416 | |
| dc.language.iso | eng | |
| dc.rights | You are granted permission for the noncommercial reproduction, distribution, display, and performance of this technical report in any format, but this permission is only for a period of forty-five (45) days from the most recent time that you verified that this technical report is still available from the Computer Science Department of Rice University under terms that include this permission. All other rights are reserved by the author(s). | |
| dc.title | Elastic Tasks: Unifying Task Parallelism and SPMD Parallelism with an Adaptive Runtime | |
| dc.type | Technical report | |
| dc.type.dcmi | Text |
Files
Original bundle
1 - 1 of 1