On Graphs with Finite-Time Consensus and Their Use in Gradient Tracking
| dc.contributor.advisor | Uribe, César | en_US |
| dc.creator | Nguyen, Edward Duc Hien | en_US |
| dc.date.accessioned | 2024-08-30T18:47:59Z | en_US |
| dc.date.created | 2024-08 | en_US |
| dc.date.issued | 2024-05-20 | en_US |
| dc.date.submitted | August 2024 | en_US |
| dc.date.updated | 2024-08-30T18:47:59Z | en_US |
| dc.description | EMBARGO NOTE: This item is embargoed until 2026-08-01 | en_US |
| dc.description.abstract | A crucial design decision when employing distributed or decentralized optimization algorithms in practice is the choice of topology. A topology should be sufficiently well connected such that when agents communicate, agents reach a consensus faster. However, more densely connected topologies come with a price of higher bandwidth cost or latency. To address this issue, we study sequences of graphs satisfying the finite-time consensus property (i.e., iterating through such a finite sequence is equivalent to performing global or exact averaging) and their use in the decentralized optimization algorithm Gradient Tracking. We provide an explicit weight matrix representation of the studied sequences and prove their finite-time consensus property. Moreover, we incorporate the studied finite-time consensus topologies into Gradient Tracking and present a new algorithmic scheme called Gradient Tracking for Finite-Time Consensus Topologies (GT-FT). We analyze the new scheme for nonconvex problems with stochastic gradient estimates. Our analysis shows that the convergence rate of GT-FT does not depend on the heterogeneity of the agents' functions or the connectivity of any individual graph in the topology sequence. Furthermore, owing to the sparsity of the graphs, GT-FT requires lower communication costs than Gradient Tracking using the static counterpart of the topology sequence. | en_US |
| dc.embargo.lift | 2026-08-01 | en_US |
| dc.embargo.terms | 2026-08-01 | en_US |
| dc.format.mimetype | application/pdf | en_US |
| dc.identifier.citation | Nguyen, Edward Duc Hien. On Graphs with Finite-Time Consensus and Their Use in Gradient Tracking. (2024). Masters thesis, Rice University. https://hdl.handle.net/1911/117846 | en_US |
| dc.identifier.uri | https://hdl.handle.net/1911/117846 | en_US |
| dc.language.iso | eng | en_US |
| dc.rights | Copyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder. | en_US |
| dc.subject | distributed optimization | en_US |
| dc.subject | decentralized optimization | en_US |
| dc.subject | finite-time consensus | en_US |
| dc.title | On Graphs with Finite-Time Consensus and Their Use in Gradient Tracking | en_US |
| dc.type | Thesis | en_US |
| dc.type.material | Text | en_US |
| thesis.degree.department | Electrical and Computer Engineering | en_US |
| thesis.degree.discipline | Engineering | en_US |
| thesis.degree.grantor | Rice University | en_US |
| thesis.degree.level | Masters | en_US |
| thesis.degree.name | Master of Science | en_US |