logo

SCIENCE CHINA Information Sciences, Volume 63 , Issue 6 : 169102(2020) https://doi.org/10.1007/s11432-018-9832-y

An accelerator for the logistic regression algorithm based on sampling on-demand

More info
  • ReceivedNov 2, 2018
  • AcceptedMar 15, 2019
  • PublishedApr 14, 2020

Abstract

There is no abstract available for this article.


Acknowledgment

This work was supported by National Natural Science Foundation of China (Grant Nos. 61876103, 61432011), Project of Key Research and Development Plan of Shanxi Province (Grant No. 201603D111- 014), and 1331 Engineering Project of Shanxi Province.


References

[1] Bai G, Tao R, Zhao J. Fast FOCUSS method based on bi-conjugate gradient and its application to space-time clutter spectrum estimation. Sci China Inf Sci, 2017, 60: 082302 CrossRef Google Scholar

[2] Li C, Zhang E, Jiu L. Optimal control on special Euclidean group via natural gradient algorithm. Sci China Inf Sci, 2016, 59: 112203 CrossRef Google Scholar

[3] Nesterov Y. Primal-dual subgradient methods for convex problems. Math Program, 2009, 120: 221-259 CrossRef Google Scholar

[4] Lei L H, Jordan M I. Less than a single pass: stochastically controlled stochastic gradient. In: Proceedings of the 20th International Conference on Artificial Intelligence and Statistics (AISTATS), Florida, 2017. 148--156. Google Scholar

[5] Wright S J. Accelerated Block-coordinate Relaxation for Regularized Optimization. SIAM J Optim, 2012, 22: 159-186 CrossRef Google Scholar

[6] Shalev-Shwartz S, Zhang T. Stochastic dual coordinate ascent methods for regularized loss minimization. J Mach Learn Res, 2013, 14: 567--599. Google Scholar

[7] Lubin M, Dunning I. Computing in Operations Research Using Julia. INFORMS J Computing, 2015, 27: 238-248 CrossRef Google Scholar

  • Table 1  

    Table 1The execution time (s) for four algorithms

    DatasetLR-GDLR-DSG LR-BGDLR-SOD
    Cifa8586.47 114.65 119.37 78.53
    Cod-rna4827.57 133.21 73.33 43.39
    Covtype7948.21 115.89 285.77 29.34
    Ijcnn11900.81 31.71 80.62 29.64
    Mnist5272.12 68.29 376.22 63.23
    Rcv13370854.18 7296.56 4050.76 1298.32
    Real-sim243920.00 1139.20 761.60 320.00
    Skin-nonskin3321.46 203.09 199.81 163.78
    Susy67645.77 757.83 11286.56 735.76

Copyright 2020  CHINA SCIENCE PUBLISHING & MEDIA LTD.  中国科技出版传媒股份有限公司  版权所有

京ICP备14028887号-23       京公网安备11010102003388号