skip to main content
Giới hạn tìm kiếm: Giới hạn tìm kiếm: Dạng tài nguyên Hiển thị kết quả với: Hiển thị kết quả với: Dạng tìm kiếm Chỉ mục

Tracking Sparse Linear Classifiers

IEEE transaction on neural networks and learning systems, 2019-07, Vol.30 (7), p.2079-2092

Distributed under a Creative Commons Attribution 4.0 International License ;ISSN: 2162-237X ;EISSN: 2162-2388 ;DOI: 10.1109/TNNLS.2018.2877433

Tài liệu số/Tài liệu điện tử

Trích dẫn Trích dẫn bởi
  • Nhan đề:
    Tracking Sparse Linear Classifiers
  • Tác giả: Zhai, Tingting ; Koriche, Frederic ; Wang, Hao ; Gao, Yang
  • Chủ đề: Computer Science ; Mathematics
  • Là 1 phần của: IEEE transaction on neural networks and learning systems, 2019-07, Vol.30 (7), p.2079-2092
  • Mô tả: In this paper, we investigate the problem of sparse online linear classification in changing environments. We first analyze the tracking performance of standard online linear classifiers, which use gradient descent for minimizing the regularized hinge loss. The derived shifting bounds highlight the importance of choosing appropriate step sizes in the presence of concept drifts. Notably, we show that a better adaptability to concept drifts can be achieved using constant step sizes rather than the state-of-the-art decreasing step sizes. Based on these observations, we then propose a novel sparse approximated linear classifier, called sparse approximated linear classification (SALC), which uses a constant step size. In essence, SALC simply rounds small weights to zero for achieving sparsity and controls the truncation error in a principled way for achieving a low tracking regret. The degree of sparsity obtained by SALC is continuous and can be controlled by a parameter which captures the tradeoff between the sparsity of the model and the regret performance of the algorithm. Experiments on nine stationary data sets show that SALC is superior to the state-of-the-art sparse online learning algorithms, especially when the solution is required to be sparse; on seven groups of nonstationary data sets with various total shifting amounts, SALC also presents a good ability to track drifts. When wrapped with a drift detector, SALC achieves a remarkable tracking performance regardless of the total shifting amount.
  • Nơi xuất bản: IEEE
  • Ngôn ngữ: English
  • Số nhận dạng: ISSN: 2162-237X
    EISSN: 2162-2388
    DOI: 10.1109/TNNLS.2018.2877433
  • Nguồn: Hyper Article en Ligne (HAL) (Open Access)

Đang tìm Cơ sở dữ liệu bên ngoài...