%PDF-1.3 1 0 obj << /Kids [ 4 0 R 5 0 R 6 0 R 7 0 R 8 0 R 9 0 R 10 0 R 11 0 R 12 0 R 13 0 R 14 0 R 15 0 R ] /Type /Pages /Count 12 >> endobj 2 0 obj << /Subject (Neural Information Processing Systems http\072\057\057nips\056cc\057) /Publisher (Curran Associates\054 Inc\056) /Language (en\055US) /Created (2019) /EventType (Poster) /Description-Abstract (We study the problem of minimizing a strongly convex\054 smooth function when we have noisy estimates of its gradient\056 We propose a novel multistage accelerated algorithm that is universally optimal in the sense that it achieves the optimal rate both in the deterministic and stochastic case and operates without knowledge of noise characteristics\056 The algorithm consists of stages that use a stochastic version of Nesterov\047s method with a specific restart and parameters selected to achieve the fastest reduction in the bias\055variance terms in the convergence rate bounds\056) /Producer (PyPDF2) /Title (A Universally Optimal Multistage Accelerated Stochastic Gradient Method) /Date (2019) /ModDate (D\07220200213021628\05508\04700\047) /Published (2019) /Type (Conference Proceedings) /firstpage (8525) /Book (Advances in Neural Information Processing Systems 32) /Description (Paper accepted and presented at the Neural Information Processing Systems Conference \050http\072\057\057nips\056cc\057\051) /Editors (H\056 Wallach and H\056 Larochelle and A\056 Beygelzimer and F\056 d\047Alch\351\055Buc and E\056 Fox and R\056 Garnett) /Author (Necdet Serhat Aybat\054 Alireza Fallah\054 Mert Gurbuzbalaban\054 Asuman Ozdaglar) /lastpage (8536) >> endobj 3 0 obj << /Type /Catalog /Pages 1 0 R >> endobj 4 0 obj << /Contents 16 0 R /Parent 1 0 R /Resources << /Font << /F14 17 0 R /F10 21 0 R /F11 25 0 R /F34 29 0 R /F13 33 0 R /F50 37 0 R /F41 41 0 R /F75 46 0 R /F7 51 0 R /F87 55 0 R /F8 59 0 R /F9 63 0 R /F38 67 0 R /F37 71 0 R /F73 75 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 79 0 R 80 0 R 81 0 R 82 0 R 83 0 R 84 0 R 85 0 R 86 0 R 87 0 R 88 0 R 89 0 R 90 0 R 91 0 R 92 0 R 93 0 R 94 0 R ] /Type /Page >> endobj 5 0 obj << /Contents 95 0 R /Parent 1 0 R /Resources << /Font << /F14 17 0 R /F49 96 0 R /F10 21 0 R /F11 25 0 R /F12 100 0 R /F13 33 0 R /F47 104 0 R /F46 108 0 R /F45 112 0 R /F1 116 0 R /F6 120 0 R /F7 51 0 R /F75 46 0 R /F87 55 0 R /F8 59 0 R /F9 63 0 R /F37 71 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 124 0 R 125 0 R 126 0 R 127 0 R 128 0 R 129 0 R 130 0 R 131 0 R 132 0 R 133 0 R 134 0 R 135 0 R 136 0 R 137 0 R 138 0 R 139 0 R 140 0 R 141 0 R 142 0 R 143 0 R 144 0 R 145 0 R 146 0 R ] /Type /Page >> endobj 6 0 obj << /Contents 147 0 R /Parent 1 0 R /Resources << /Font << /F14 17 0 R /F10 21 0 R /F11 25 0 R /F13 33 0 R /F113 148 0 R /F47 104 0 R /F45 112 0 R /F75 46 0 R /F7 51 0 R /F87 55 0 R /F8 59 0 R /F37 71 0 R /F73 75 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 152 0 R 153 0 R 154 0 R 155 0 R 156 0 R 157 0 R 158 0 R 159 0 R 160 0 R 161 0 R 162 0 R 163 0 R 164 0 R 165 0 R 166 0 R 167 0 R 168 0 R 169 0 R 170 0 R 171 0 R 172 0 R 173 0 R 174 0 R ] /Type /Page >> endobj 7 0 obj << /Contents 175 0 R /Parent 1 0 R /Resources << /Font << /F14 17 0 R /F32 176 0 R /F49 96 0 R /F10 21 0 R /F11 25 0 R /F34 29 0 R /F13 33 0 R /F51 180 0 R /F47 104 0 R /F46 108 0 R /F45 112 0 R /F1 116 0 R /F73 75 0 R /F75 46 0 R /F87 55 0 R /F8 59 0 R /F9 63 0 R /F37 71 0 R /F7 51 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 184 0 R 185 0 R 186 0 R 187 0 R 188 0 R 189 0 R 190 0 R 191 0 R 192 0 R 193 0 R 194 0 R ] /Type /Page >> endobj 8 0 obj << /Contents 195 0 R /Parent 1 0 R /Resources << /Font << /F14 17 0 R /F49 96 0 R /F10 21 0 R /F11 25 0 R /F12 100 0 R /F13 33 0 R /F7 51 0 R /F51 180 0 R /F47 104 0 R /F75 46 0 R /F45 112 0 R /F1 116 0 R /F6 120 0 R /F73 75 0 R /F87 55 0 R /F8 59 0 R /F9 63 0 R /F37 71 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 196 0 R 197 0 R 198 0 R 199 0 R 200 0 R 201 0 R 202 0 R 203 0 R 204 0 R 205 0 R 206 0 R 207 0 R ] /Type /Page >> endobj 9 0 obj << /Contents 208 0 R /Parent 1 0 R /Resources << /Font << /F14 17 0 R /F10 21 0 R /F11 25 0 R /F34 29 0 R /F13 33 0 R /F73 75 0 R /F38 67 0 R /F75 46 0 R /F1 116 0 R /F6 120 0 R /F7 51 0 R /F87 55 0 R /F8 59 0 R /F9 63 0 R /F37 71 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 209 0 R 210 0 R 211 0 R 212 0 R 213 0 R 214 0 R 215 0 R 216 0 R 217 0 R 218 0 R 219 0 R 220 0 R 221 0 R 222 0 R 223 0 R 224 0 R 225 0 R 226 0 R 227 0 R 228 0 R 229 0 R 230 0 R 231 0 R 232 0 R 233 0 R ] /Type /Page >> endobj 10 0 obj << /Contents 234 0 R /Parent 1 0 R /Resources << /Font << /F14 17 0 R /F49 96 0 R /F10 21 0 R /F11 25 0 R /F7 51 0 R /F13 33 0 R /F51 180 0 R /F186 235 0 R /F47 104 0 R /F46 108 0 R /F45 112 0 R /F1 116 0 R /F6 120 0 R /F73 75 0 R /F75 46 0 R /F87 55 0 R /F8 59 0 R /F9 63 0 R /F37 71 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 239 0 R 240 0 R 241 0 R 242 0 R 243 0 R 244 0 R 245 0 R 246 0 R 247 0 R 248 0 R 249 0 R 250 0 R 251 0 R 252 0 R 253 0 R ] /Type /Page >> endobj 11 0 obj << /Contents 254 0 R /Parent 1 0 R /Resources << /XObject << /Im6 255 0 R /Im5 262 0 R /Im4 269 0 R /Im3 276 0 R /Im2 282 0 R /Im1 288 0 R >> /Font << /F14 17 0 R /F49 96 0 R /F48 294 0 R /F10 21 0 R /F11 25 0 R /F13 33 0 R /F50 37 0 R /F73 75 0 R /F47 104 0 R /F46 108 0 R /F45 112 0 R /F75 46 0 R /F6 120 0 R /F7 51 0 R /F87 55 0 R /F8 59 0 R /F37 71 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 298 0 R 299 0 R 300 0 R 301 0 R 302 0 R 303 0 R 304 0 R 305 0 R 306 0 R 307 0 R 308 0 R 309 0 R 310 0 R 311 0 R 312 0 R 313 0 R 314 0 R ] /Type /Page >> endobj 12 0 obj << /Contents 315 0 R /Parent 1 0 R /Resources << /XObject << /Im7 316 0 R /Im9 323 0 R /Im8 330 0 R >> /Font << /F14 17 0 R /F10 21 0 R /F11 25 0 R /F13 33 0 R /F50 37 0 R /F47 104 0 R /F45 112 0 R /F75 46 0 R /F7 51 0 R /F8 59 0 R /F73 75 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 337 0 R 338 0 R 339 0 R 340 0 R 341 0 R 342 0 R 343 0 R 344 0 R 345 0 R ] /Type /Page >> endobj 13 0 obj << /Contents 346 0 R /Parent 1 0 R /Resources << /Font << /F87 55 0 R /F14 17 0 R /F75 46 0 R /F73 75 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Type /Page >> endobj 14 0 obj << /Contents 347 0 R /Parent 1 0 R /Resources << /Font << /F87 55 0 R /F41 41 0 R /F75 46 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Annots [ 348 0 R 349 0 R ] /Type /Page >> endobj 15 0 obj << /Contents 350 0 R /Parent 1 0 R /Resources << /Font << /F87 55 0 R /F75 46 0 R >> >> /Rotate 360 /MediaBox [ 0 0 612 792 ] /Type /Page >> endobj 16 0 obj << /Length 3690 /Filter /FlateDecode >> stream xZYF~_}Z uda qkOv
8-cFc%|ݦ昹kɣ-xE*Fd^*(2n7 vwyU5QVۼy Rw u^w$'0MR3# toSp7?|xyF Kaǩ]R_ߨ Pc_"Ig