skip to main content
Language:
Search Limited to: Search Limited to: Resource type Show Results with: Show Results with: Search type Index

Robust high dimensional learning for Lipschitz and convex losses

Journal of machine learning research, 2021-01 (21), p.1-47 [Peer Reviewed Journal]

2021. This work is published under http://arxiv.org/licenses/nonexclusive-distrib/1.0/ (the “License”). Notwithstanding the ProQuest Terms and Conditions, you may use this content in accordance with the terms of the License. ;http://arxiv.org/licenses/nonexclusive-distrib/1.0 ;Attribution ;ISSN: 1532-4435 ;EISSN: 2331-8422 ;EISSN: 1533-7928 ;DOI: 10.48550/arxiv.1905.04281

Full text available

Citations Cited by
  • Title:
    Robust high dimensional learning for Lipschitz and convex losses
  • Author: Chinot, Geoffrey ; Lecué, Guillaume ; Lerasle, Matthieu
  • Subjects: Algorithms ; Empirical analysis ; Learning theory ; Mathematics - Statistics Theory ; Outliers (statistics) ; Regression analysis ; Regularization ; Statistics ; Statistics - Theory
  • Is Part Of: Journal of machine learning research, 2021-01 (21), p.1-47
  • Description: We establish risk bounds for Regularized Empirical Risk Minimizers (RERM) when the loss is Lipschitz and convex and the regularization function is a norm. In a first part, we obtain these results in the i.i.d. setup under subgaussian assumptions on the design. In a second part, a more general framework where the design might have heavier tails and data may be corrupted by outliers both in the design and the response variables is considered. In this situation, RERM performs poorly in general. We analyse an alternative procedure based on median-of-means principles and called minmax MOM. We show optimal subgaussian deviation rates for these estimators in the relaxed setting. The main results are meta-theorems allowing a wide-range of applications to various problems in learning theory. To show a non-exhaustive sample of these potential applications, it is applied to classification problems with logistic loss functions regularized by LASSO and SLOPE, to regression problems with Huber loss regularized by Group LASSO and Total Variation. Another advantage of the minmax MOM formulation is that it suggests a systematic way to slightly modify descent based algorithms used in high-dimensional statistics to make them robust to outliers. We illustrate this principle in a Simulations section where a minmax MOM version of classical proximal descent algorithms are turned into robust to outliers algorithms.
  • Publisher: Ithaca: Cornell University Library, arXiv.org
  • Language: English
  • Identifier: ISSN: 1532-4435
    EISSN: 2331-8422
    EISSN: 1533-7928
    DOI: 10.48550/arxiv.1905.04281
  • Source: Freely Accessible Journals
    arXiv.org
    Hyper Article en Ligne (HAL) (Open Access)
    Alma/SFX Local Collection
    ROAD: Directory of Open Access Scholarly Resources
    ProQuest Central
Back to results list
INSPIRE LIBRARY - TON DUC THANG UNIVERSITY (84-028) 37 755 057 Feedback
19 Nguyen Huu Tho St. Dist.7, HCM thuvien@tdtu.edu.vn

Copyright © 2017 INSPIRE LIBRARY - TON DUC THANG UNIVERSITY

Searching Remote Databases, Please Wait