Sarkar, Vivek2019-05-162019-05-162017-082017-09-11August 201Peng, Yuhan. "Static Cost Estimation for Data Layout Selection on GPUs." (2017) Master’s Thesis, Rice University. <a href="https://hdl.handle.net/1911/105450">https://hdl.handle.net/1911/105450</a>.https://hdl.handle.net/1911/105450Performance modeling provides mathematical models and quantitative analysis for designing and optimizing computer systems and architectures. For many data-intensive applications, high-latency memory accesses often dominate execution time. Thus, performance modeling for memory accesses on high performance architectures has become an important research topic. The data layout of an application refers to the way in which data is stored and organized. In high performance computation, the data layout can significantly affect the efficiency of memory access operations. In recent years, the problem of data layout selection has been well studied on various multi-core CPU and some heterogeneous architectures. GPUs have memory hierarchies different from multi-core CPUs. While data layout selection on GPUs has been studied previously, none of the prior work provides a mathematical cost model for data layout selection on GPUs. This motivates us to investigate static cost analysis methods to guide data layout selection work, and perhaps even the design of new SIMT architectures. This thesis presents a comprehensive cost analysis for data layout selection on GPUs. We build our cost function based on knowledge of the GPU memory hierarchy, and develop an algorithm which enables researchers to perform compile time cost estimation for a given data layout. Furthermore, we introduce a new vector based cost representation of the estimated cost, which can better estimate the memory access cost of applications with dynamic length loops. We apply our cost analysis to benchmarks considered by prior work on data layout selection, and our experimental results show that our cost analysis can accurately predict the relative costs of different data layouts.application/pdfengCopyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder.Data Layout SelectionCost EstimationGPUsThesis2019-05-16