Mitigating the effect of dataset shift in clustering

Maldonado, SebastiÁn A.; Saltos, Ramiro; Vairetti, Carla; Delpiano, José

Abstract

Dataset shift is a relevant topic in unsupervised learning since many applications face evolving environments, causing an important loss of generalization and performance. Most techniques that deal with this issue are designed for data stream clustering, whose goal is to process sequences of data efficiently under Big Data. In this study, we claim dataset shift is an issue for static clustering tasks in which data is collected over a long period. To mitigate it, we propose Time-weighted kernel -means, a -means variant that includes a time-dependent weighting process. We do this via the induced ordered weighted average (IOWA) operator. The weighting process acts as a gradual forgetting mechanism, prioritizing recent examples over outdated ones in the clustering algorithm. The computational experiments show the potential Time-weighted kernel -means has in evolving environments.

Más información

Título de la Revista: PATTERN RECOGNITION
Volumen: 134
Editorial: Elsevier
Fecha de publicación: 2023
URL: https://doi.org/10.1016/j.patcog.2022.109058