SKETCH TOWARD ONLINE RISK MINIMIZATION
| dc.contributor.advisor | Shrivastava, Anshumali | en_US |
| dc.creator | Gupta, Gaurav | en_US |
| dc.date.accessioned | 2022-10-04T16:32:23Z | en_US |
| dc.date.available | 2022-10-04T16:32:23Z | en_US |
| dc.date.created | 2022-05 | en_US |
| dc.date.issued | 2022-01-27 | en_US |
| dc.date.submitted | May 2022 | en_US |
| dc.date.updated | 2022-10-04T16:32:24Z | en_US |
| dc.description.abstract | Empirical risk minimization (ERM) is perhaps the most in uential idea in statistical learning, with applications to nearly all scienti c and technical domains in the form of regression and classi cation models. The growing concerns about the high energy cost of training and the increased prevalence of massive streaming datasets have led many ML practitioners to look for approximate ERM models that can achieve low cost on memory and latency for training. To this end, we propose STORM- Sketch Toward Online Risk Minimization, an online sketching-based method for empirical risk minimization. STORM compresses a data stream into a tiny array of integer counters. This sketch is su cient to estimate a variety of surrogate losses over the original dataset. We provide rigorous theoretical analysis and show that STORM can estimate a carefully chosen surrogate loss for regularized least-squares regression and a margin loss for classi cation. We perform an exhaustive experimental comparison for regression and classi cation training on real-world datasets, achieving an approximate solution with size even less than a data sample. | en_US |
| dc.format.mimetype | application/pdf | en_US |
| dc.identifier.citation | Gupta, Gaurav. "SKETCH TOWARD ONLINE RISK MINIMIZATION." (2022) Master’s Thesis, Rice University. <a href="https://hdl.handle.net/1911/113483">https://hdl.handle.net/1911/113483</a>. | en_US |
| dc.identifier.uri | https://hdl.handle.net/1911/113483 | en_US |
| dc.language.iso | eng | en_US |
| dc.rights | Copyright is held by the author, unless otherwise indicated. Permission to reuse, publish, or reproduce the work beyond the bounds of fair use or other exemptions to copyright law must be obtained from the copyright holder. | en_US |
| dc.subject | Empirical risk minimization | en_US |
| dc.subject | Sketching | en_US |
| dc.title | SKETCH TOWARD ONLINE RISK MINIMIZATION | en_US |
| dc.type | Thesis | en_US |
| dc.type.material | Text | en_US |
| thesis.degree.department | Electrical and Computer Engineering | en_US |
| thesis.degree.discipline | Engineering | en_US |
| thesis.degree.grantor | Rice University | en_US |
| thesis.degree.level | Masters | en_US |
| thesis.degree.name | Master of Science | en_US |
Files
Original bundle
1 - 1 of 1