GenClassifier4CL
Financiado
Incrementally learning new classes with generative classification
"Learning continually from non-stationary streams of data is a key feature of natural intelligence, but an unsolved problem in deep learning. Particularly challenging for deep neural networks is the problem of ""class-incremental...
"Learning continually from non-stationary streams of data is a key feature of natural intelligence, but an unsolved problem in deep learning. Particularly challenging for deep neural networks is the problem of ""class-incremental learning"", whereby a network must learn to distinguish classes that are not observed together. In deep learning, the default approach to classification is learning discriminative classifiers. This works great in the i.i.d. setting when all classes are available simultaneously, but when new classes must be learned incrementally, successful training of discriminative classifiers depends on workarounds such as storing data or generative replay. In a radical shift of gears, here I propose to instead address class-incremental learning with generative classification. Key advantage is that generative classifiers – unlike discriminative classifiers – do not compare classes during training, but only during inference (i.e., when making a classification decision). As a proof-of-concept, in preliminary work I showed that a naïve implementation of a generative classifier, with a separate variational autoencoder model per class and likelihood estimation through importance sampling, outperforms comparable generative replay methods. To improve the efficiency, scalability, and performance of this generative classifier, I propose four further modifications: (1) move the generative modelling objective from the raw inputs to an intermediate network layer; (2) share the encoder network between classes, but not necessarily the decoder networks; (3) use fewer importance samples for unlikely classes; and (4) make classification decisions hierarchical. This way, during my MSCA fellowship hosted in the group of Prof Tinne Tuytelaars, I hope to develop generative classification into a practical, efficient, and scalable state-of-the-art deep learning method for class-incremental learning."
ver más
Duración del proyecto: 27 meses
Fecha Inicio: 2022-06-23
Fecha Fin: 2024-09-30
Fecha Fin: 2024-09-30
Línea de financiación: concedida
El organismo HORIZON EUROPE notifico la concesión del proyecto el día 2024-09-30
Línea de financiación objetivo
El proyecto se financió a través de la siguiente ayuda:
HORIZON-MSCA-2021-PF-01-01:
MSCA Postdoctoral Fellowships 2021
Cerrada
hace 3 años
Presupuesto
El presupuesto total del proyecto asciende a
192K€
Líder del proyecto
KATHOLIEKE UNIVERSITEIT LEUVEN
No se ha especificado una descripción o un objeto social para esta compañía.
Perfil tecnológico
TRL
4-5
Perfil tecnológico
TRL
4-5