International Journal of Market Research, Volume 66, Issue 5, Page 559-566, September 2024.
Machine learning classifiers are increasingly widely used. This research note explores how a particular widely used classifier, the Random Forest, performs when faced with samples which are imbalanced and noisy data. Both are known to affect accuracy, but if their effects are independent or not has not been explored. Based on an experiment using synthetic data generated for the study we find that the effects of noise and sample balance interact with each other; classification accuracy is worse when faced with both noisy data and sample imbalance. This has implications for the use of RF in market research, but also for how methods to address either sample imbalance or noise are assessed.
International Journal of Market Research, Volume 66, Issue 5, Page 559-566, September 2024. <br/>Machine learning classifiers are increasingly widely used. This research note explores how a particular widely used classifier, the Random Forest, performs when faced with samples which are imbalanced and noisy data. Both are known to affect accuracy, but if their effects are independent or not has not been explored. Based on an experiment using synthetic data generated for the study we find that the effects of noise and sample balance interact with each other; classification accuracy is worse when faced with both noisy data and sample imbalance. This has implications for the use of RF in market research, but also for how methods to address either sample imbalance or noise are assessed. Read More
Related posts:
Accuracy and practical considerations in an RDD text-to-web survey
Effect of branching middle responses in dichotomous scales on web surveys
Examining the use of explicit ‘no opinion’ options in attitude survey design
Evaluating emotional and subjective responses in synthetic art-related dialogues: A multi-stage framework with large language models
Beyond purchase intention in sports sponsorship: an alternative approach to measuring brand equity using best-worst scaling
Informal human resource management and innovation: Insights from European SMEs