Home
This Title All WIREs
WIREs RSS Feed
How to cite this WIREs title:
WIREs Data Mining Knowl Discov
Impact Factor: 1.939

Machine learning from crowds: A systematic review of its applications

Full article on Wiley Online Library:   HTML PDF

Can't access this content? Tell your librarian.

Crowdsourcing opens the door to solving a wide variety of problems that previously were unfeasible in the field of machine learning, allowing us to obtain relatively low cost labeled data in a small amount of time. However, due to the uncertain quality of labelers, the data to deal with are sometimes unreliable, forcing practitioners to collect information redundantly, which poses new challenges in the field. Despite these difficulties, many applications of machine learning using crowdsourced data have recently been published that achieved state of the art results in relevant problems. We have analyzed these applications following a systematic methodology, classifying them into different fields of study, highlighting several of their characteristics and showing the recent interest in the use of crowdsourcing for machine learning. We also identify several exciting research lines based on the problems that remain unsolved to foster future research in this field.

This article is categorized under:

  • Technologies > Machine Learning
  • Application Areas > Science and Technology
  • Fundamental Concepts of Data and Knowledge > Key Design Issues in Data Mining
Thanks to crowdsourcing platforms, several problems that seemed impossible to tackle from a machine learning perspective, can now be solved. To discover how crowdsourced data is used as well as what are the main problems derived from its use, we analyze many applications in several fields of interest
[ Normal View | Magnified View ]
Distribution of publications by proposed problems
[ Normal View | Magnified View ]
Knowledge area by worker type and technique
[ Normal View | Magnified View ]
Aggregation techniques
[ Normal View | Magnified View ]
Distribution of crowd category publications by platform
[ Normal View | Magnified View ]
Distribution of publications by worker type
[ Normal View | Magnified View ]
Number of publications by country in comparison with the total for the country
[ Normal View | Magnified View ]
Number of publications by year (2010–2018)
[ Normal View | Magnified View ]

Browse by Topic

Application Areas > Science and Technology
Fundamental Concepts of Data and Knowledge > Key Design Issues in Data Mining
Technologies > Machine Learning

Access to this WIREs title is by subscription only.

Recommend to Your
Librarian Now!

The latest WIREs articles in your inbox

Sign Up for Article Alerts