skip to main content
Language:
Search Limited to: Search Limited to: Resource type Show Results with: Show Results with: Search type Index

Tracking Sparse Linear Classifiers

IEEE transaction on neural networks and learning systems, 2019-07, Vol.30 (7), p.2079-2092

Distributed under a Creative Commons Attribution 4.0 International License ;ISSN: 2162-237X ;EISSN: 2162-2388 ;DOI: 10.1109/TNNLS.2018.2877433

Digital Resources/Online E-Resources

Citations Cited by
  • Title:
    Tracking Sparse Linear Classifiers
  • Author: Zhai, Tingting ; Koriche, Frederic ; Wang, Hao ; Gao, Yang
  • Subjects: Computer Science ; Mathematics
  • Is Part Of: IEEE transaction on neural networks and learning systems, 2019-07, Vol.30 (7), p.2079-2092
  • Description: In this paper, we investigate the problem of sparse online linear classification in changing environments. We first analyze the tracking performance of standard online linear classifiers, which use gradient descent for minimizing the regularized hinge loss. The derived shifting bounds highlight the importance of choosing appropriate step sizes in the presence of concept drifts. Notably, we show that a better adaptability to concept drifts can be achieved using constant step sizes rather than the state-of-the-art decreasing step sizes. Based on these observations, we then propose a novel sparse approximated linear classifier, called sparse approximated linear classification (SALC), which uses a constant step size. In essence, SALC simply rounds small weights to zero for achieving sparsity and controls the truncation error in a principled way for achieving a low tracking regret. The degree of sparsity obtained by SALC is continuous and can be controlled by a parameter which captures the tradeoff between the sparsity of the model and the regret performance of the algorithm. Experiments on nine stationary data sets show that SALC is superior to the state-of-the-art sparse online learning algorithms, especially when the solution is required to be sparse; on seven groups of nonstationary data sets with various total shifting amounts, SALC also presents a good ability to track drifts. When wrapped with a drift detector, SALC achieves a remarkable tracking performance regardless of the total shifting amount.
  • Publisher: IEEE
  • Language: English
  • Identifier: ISSN: 2162-237X
    EISSN: 2162-2388
    DOI: 10.1109/TNNLS.2018.2877433
  • Source: Hyper Article en Ligne (HAL) (Open Access)
Back to results list
INSPIRE LIBRARY - TON DUC THANG UNIVERSITY (84-028) 37 755 057 Feedback
19 Nguyen Huu Tho St. Dist.7, HCM thuvien@tdtu.edu.vn

Copyright © 2017 INSPIRE LIBRARY - TON DUC THANG UNIVERSITY

Searching Remote Databases, Please Wait