%PDF-1.3 1 0 obj << /Kids [ 4 0 R 5 0 R 6 0 R 7 0 R 8 0 R 9 0 R 10 0 R 11 0 R 12 0 R 13 0 R 14 0 R 15 0 R ] /Type /Pages /Count 12 >> endobj 2 0 obj << /Subject (Neural Information Processing Systems http\072\057\057nips\056cc\057) /Publisher (Curran Associates\054 Inc\056) /Language (en\055US) /Created (2018) /EventType (Poster) /Description-Abstract (Error bound conditions \050EBC\051 are properties that characterize the growth of an objective function when a point is moved away from the optimal set\056 They have recently received increasing attention in the field of optimization for developing optimization algorithms with fast convergence\056 However\054 the studies of EBC in statistical learning are hitherto still limited\056 The main contributions of this paper are two\055fold\056 First\054 we develop fast and intermediate rates of empirical risk minimization \050ERM\051 under EBC for risk minimization with Lipschitz continuous\054 and smooth convex random functions\056 Second\054 we establish fast and intermediate rates of an efficient stochastic approximation \050SA\051 algorithm for risk minimization with Lipschitz continuous random functions\054 which requires only one pass of \044n\044 samples and adapts to EBC\056 For both approaches\054 the convergence rates span a full spectrum between \044\134widetilde O\0501\057\134sqrt\173n\175\051\044 and \044\134widetilde O\0501\057n\051\044 depending on the power constant in EBC\054 and could be even faster than \044O\0501\057n\051\044 in special cases for ERM\056 Moreover\054 these convergence rates are automatically adaptive without using any knowledge of EBC\056 Overall\054 this work not only strengthens the understanding of ERM for statistical learning but also brings new fast stochastic algorithms for solving a broad range of statistical learning problems\056) /Producer (PyPDF2) /Title (Fast Rates of ERM and Stochastic Approximation\072 Adaptive to Error Bound Conditions) /Date (2018) /ModDate (D\07220191111110112\05508\04700\047) /Published (2018) /Type (Conference Proceedings) /firstpage (4678) /Book (Advances in Neural Information Processing Systems 31) /Description (Paper accepted and presented at the Neural Information Processing Systems Conference \050http\072\057\057nips\056cc\057\051) /Editors (S\056 Bengio and H\056 Wallach and H\056 Larochelle and K\056 Grauman and N\056 Cesa\055Bianchi and R\056 Garnett) /Author (Mingrui Liu\054 Xiaoxuan Zhang\054 Lijun Zhang\054 Rong Jin\054 Tianbao Yang) /lastpage (4689) >> endobj 3 0 obj << /Type /Catalog /Pages 1 0 R >> endobj 4 0 obj << /Contents [ 16 0 R 17 0 R 18 0 R 19 0 R 20 0 R 21 0 R 22 0 R 23 0 R ] /Parent 1 0 R /Resources << /Font << /F14 24 0 R /F30 28 0 R /F26 33 0 R /F10 37 0 R /F11 41 0 R /F13 45 0 R /F43 49 0 R /F51 53 0 R /F27 58 0 R /F53 62 0 R /F23 66 0 R /F44 70 0 R /F1 74 0 R /F8 78 0 R >> >> /Rotate 360 /CropBox [ 0 0 612 792 ] /MediaBox [ 0 0 612 792 ] /Annots [ 82 0 R 83 0 R 84 0 R ] /Type /Page >> endobj 5 0 obj << /Contents 85 0 R /Parent 1 0 R /Resources << /Font << /F14 24 0 R /F26 33 0 R /F10 37 0 R /F11 41 0 R /F12 86 0 R /F13 45 0 R /F43 49 0 R /F51 53 0 R /F53 62 0 R /F44 70 0 R /F76 90 0 R /F74 94 0 R /F1 74 0 R /F6 98 0 R /F7 102 0 R /F70 106 0 R /F72 110 0 R /F112 114 0 R /F9 118 0 R /F8 78 0 R >> >> /Rotate 360 /CropBox [ 0 0 612 792 ] /MediaBox [ 0 0 612 792 ] /Annots [ 122 0 R 123 0 R 124 0 R 125 0 R 126 0 R 127 0 R 128 0 R 129 0 R 130 0 R 131 0 R 132 0 R 133 0 R 134 0 R 135 0 R 136 0 R 137 0 R 138 0 R 139 0 R 140 0 R 141 0 R 142 0 R 143 0 R ] /Type /Page >> endobj 6 0 obj << /Contents 144 0 R /Parent 1 0 R /Resources << /Font << /F14 24 0 R /F10 37 0 R /F11 41 0 R /F12 86 0 R /F13 45 0 R /F43 49 0 R /F51 53 0 R /F53 62 0 R /F1 74 0 R /F112 114 0 R /F7 102 0 R /F6 98 0 R /F8 78 0 R /F9 118 0 R >> >> /Rotate 360 /CropBox [ 0 0 612 792 ] /MediaBox [ 0 0 612 792 ] /Annots [ 145 0 R 146 0 R 147 0 R 148 0 R 149 0 R 150 0 R 151 0 R 152 0 R 153 0 R 154 0 R 155 0 R 156 0 R 157 0 R 158 0 R 159 0 R 160 0 R 161 0 R 162 0 R 163 0 R 164 0 R 165 0 R 166 0 R 167 0 R 168 0 R 169 0 R 170 0 R 171 0 R 172 0 R 173 0 R 174 0 R 175 0 R 176 0 R 177 0 R 178 0 R 179 0 R 180 0 R 181 0 R ] /Type /Page >> endobj 7 0 obj << /Contents 182 0 R /Parent 1 0 R /Resources << /Font << /F14 24 0 R /F26 33 0 R /F10 37 0 R /F11 41 0 R /F12 86 0 R /F13 45 0 R /F43 49 0 R /F51 53 0 R /F27 58 0 R /F53 62 0 R /F23 66 0 R /F44 70 0 R /F1 74 0 R /F112 114 0 R /F7 102 0 R /F8 78 0 R >> >> /Rotate 360 /CropBox [ 0 0 612 792 ] /MediaBox [ 0 0 612 792 ] /Annots [ 183 0 R 184 0 R 185 0 R 186 0 R 187 0 R 188 0 R 189 0 R 190 0 R 191 0 R 192 0 R 193 0 R 194 0 R 195 0 R 196 0 R 197 0 R 198 0 R 199 0 R 200 0 R 201 0 R ] /Type /Page >> endobj 8 0 obj << /Contents 202 0 R /Parent 1 0 R /Resources << /Font << /F14 24 0 R /F10 37 0 R /F11 41 0 R /F12 86 0 R /F13 45 0 R /F43 49 0 R /F51 53 0 R /F53 62 0 R /F23 66 0 R /F44 70 0 R /F1 74 0 R /F112 114 0 R /F7 102 0 R /F6 98 0 R /F8 78 0 R /F9 118 0 R >> >> /Rotate 360 /CropBox [ 0 0 612 792 ] /MediaBox [ 0 0 612 792 ] /Annots [ 203 0 R 204 0 R 205 0 R 206 0 R 207 0 R 208 0 R 209 0 R 210 0 R 211 0 R 212 0 R 213 0 R 214 0 R 215 0 R 216 0 R 217 0 R 218 0 R 219 0 R 220 0 R 221 0 R 222 0 R 223 0 R 224 0 R ] /Type /Page >> endobj 9 0 obj << /Contents 225 0 R /Parent 1 0 R /Resources << /Font << /F14 24 0 R /F26 33 0 R /F10 37 0 R /F11 41 0 R /F12 86 0 R /F13 45 0 R /F43 49 0 R /F51 53 0 R /F53 62 0 R /F23 66 0 R /F44 70 0 R /F1 74 0 R /F112 114 0 R /F7 102 0 R /F6 98 0 R /F8 78 0 R /F9 118 0 R >> >> /Rotate 360 /CropBox [ 0 0 612 792 ] /MediaBox [ 0 0 612 792 ] /Annots [ 226 0 R 227 0 R 228 0 R 229 0 R 230 0 R 231 0 R 232 0 R 233 0 R 234 0 R 235 0 R 236 0 R 237 0 R 238 0 R 239 0 R ] /Type /Page >> endobj 10 0 obj << /Contents 240 0 R /Parent 1 0 R /Resources << /Font << /F14 24 0 R /F26 33 0 R /F10 37 0 R /F11 41 0 R /F13 45 0 R /F43 49 0 R /F51 53 0 R /F27 58 0 R /F53 62 0 R /F23 66 0 R /F44 70 0 R /F1 74 0 R /F6 98 0 R /F7 102 0 R /F70 106 0 R /F72 110 0 R /F112 114 0 R /F9 118 0 R /F8 78 0 R >> >> /Rotate 360 /CropBox [ 0 0 612 792 ] /MediaBox [ 0 0 612 792 ] /Annots [ 241 0 R 242 0 R 243 0 R 244 0 R 245 0 R 246 0 R 247 0 R 248 0 R 249 0 R 250 0 R 251 0 R 252 0 R 253 0 R 254 0 R 255 0 R 256 0 R 257 0 R 258 0 R ] /Type /Page >> endobj 11 0 obj << /Contents 259 0 R /Parent 1 0 R /Resources << /XObject << /Im4 260 0 R /Im3 270 0 R /Im2 280 0 R /Im1 290 0 R >> /Font << /F14 24 0 R /F26 33 0 R /F10 37 0 R /F11 41 0 R /F13 45 0 R /F43 49 0 R /F51 53 0 R /F27 58 0 R /F53 62 0 R /F23 66 0 R /F44 70 0 R /F1 74 0 R /F112 114 0 R /F7 102 0 R /F6 98 0 R /F8 78 0 R /F9 118 0 R >> >> /Rotate 360 /CropBox [ 0 0 612 792 ] /MediaBox [ 0 0 612 792 ] /Annots [ 300 0 R 301 0 R 302 0 R 303 0 R 304 0 R 305 0 R 306 0 R 307 0 R 308 0 R 309 0 R ] /Type /Page >> endobj 12 0 obj << /Contents 310 0 R /Parent 1 0 R /Resources << /Font << /F14 24 0 R /F11 41 0 R /F51 53 0 R /F53 62 0 R /F1 74 0 R /F112 114 0 R /F7 102 0 R /F8 78 0 R >> >> /Rotate 360 /CropBox [ 0 0 612 792 ] /MediaBox [ 0 0 612 792 ] /Annots [ 311 0 R 312 0 R 313 0 R ] /Type /Page >> endobj 13 0 obj << /Contents 314 0 R /Rotate 360 /Resources << /Font << /F53 62 0 R /F112 114 0 R >> >> /CropBox [ 0 0 612 792 ] /Parent 1 0 R /MediaBox [ 0 0 612 792 ] /Type /Page >> endobj 14 0 obj << /Contents 315 0 R /Rotate 360 /Resources << /Font << /F53 62 0 R /F112 114 0 R >> >> /CropBox [ 0 0 612 792 ] /Parent 1 0 R /MediaBox [ 0 0 612 792 ] /Type /Page >> endobj 15 0 obj << /Contents 316 0 R /Rotate 360 /Resources << /Font << /F53 62 0 R /F112 114 0 R >> >> /CropBox [ 0 0 612 792 ] /Parent 1 0 R /MediaBox [ 0 0 612 792 ] /Type /Page >> endobj 16 0 obj << /Length 757 /Filter /FlateDecode >> stream HUmo0_Dj\Ď3M(kvmiL*YH֗_?']4!sE d?`$@!M90Ty0>GYb0`bx"`(̂\aD\:__H=qmuQ]ժ {UZ&&ABN(p S