Home
This Title All WIREs
WIREs RSS Feed
How to cite this WIREs title:
WIREs Data Mining Knowl Discov
Impact Factor: 2.541

Model selection and error estimation without the agonizing pain

Full article on Wiley Online Library:   HTML PDF

Can't access this content? Tell your librarian.

How can we select the best performing data‐driven model? How can we rigorously estimate its generalization error? Statistical learning theory (SLT) answers these questions by deriving nonasymptotic bounds on the generalization error of a model or, in other words, by delivering upper bounding of the true error of the learned model based just on quantities computed on the available data. However, for a long time, SLT has been considered only as an abstract theoretical framework, useful for inspiring new learning approaches, but with limited applicability to practical problems. The purpose of this review is to give an intelligible overview of the problems of model selection (MS) and error estimation (EE), by focusing on the ideas behind the different SLT‐based approaches and simplifying most of the technical aspects with the purpose of making them more accessible and usable in practice. We start by presenting the seminal works of the 80s until the most recent results, then discuss open problems and finally outline future directions of this field of research. This article is categorized under: Algorithmic Development > Statistics
Human inference approaches based on the philosopher Charles Sanders Peirce
[ Normal View | Magnified View ]
Advantages and disadvantages of using error estimation (EE) for model selection (MS) purposes
[ Normal View | Magnified View ]
The Bayes' rule, its approximation and the different sources of error
[ Normal View | Magnified View ]
The statistical learning (SL) problem
[ Normal View | Magnified View ]

Related Articles

Top Ten WIDM Articles

Browse by Topic

Algorithmic Development > Statistics

Access to this WIREs title is by subscription only.

Recommend to Your
Librarian Now!

The latest WIREs articles in your inbox

Sign Up for Article Alerts