Innovating Works

RSM

Financiado
Rich Structured Models for Scene Recovery Understanding and Interaction
Computer vision has gained considerable momentum in recent years – both in industry and academia. There seems to be a spirit that the time is ripe to realize grand goals and to bring computer vision from the lab into real life. Bu... Computer vision has gained considerable momentum in recent years – both in industry and academia. There seems to be a spirit that the time is ripe to realize grand goals and to bring computer vision from the lab into real life. But is a vision system already as good as a human is? The answer is: Unfortunately, not yet. Given a single image, a child can describe the objects and their relationships in a much more detailed manner than any computer can. Also, humans can quite effortlessly visually extract an object from its background, even in the presence of fine details such as hair. Computers cannot yet achieve this automatically. But, for many real-world applications it is absolutely necessary to reach such levels of rich output, accuracy, quality, robustness, and system autonomy. In this proposal we try to get closer to this overarching goal. We believe that the key to success is a richer representation. Here rich stands for rich, detailed output, modelling rich, physical and semantic constraints, and learning rich, statistical relations between different aspects of a scene. Towards this end we propose the Rich Scene Model (RSM), which is one joint statistical, structured model of many physical and semantic scene aspects that can take full advantage of the synergy effect between all its components. This effort goes beyond previous attempts, in many respects. However, it is simple to say We will build the best ever joint, rich scene model. Accordingly, the crux of this proposal is to design novel models, learning and inference techniques to make the RSM a reality. This proposal addresses not only theoretical questions such as, What can we infer from a few images of a dynamically changing 3D scene?, and Is our RSM rich enough to make statistical learning work better than deterministic learning? we also propose a model that can give new forms of output, better deal with challenging real world scenarios, and can adapt nicely to human and application needs ver más
30/09/2021
UHEI
2M€
Duración del proyecto: 74 meses Fecha Inicio: 2015-07-01
Fecha Fin: 2021-09-30

Línea de financiación: concedida

El organismo H2020 notifico la concesión del proyecto el día 2021-09-30
Línea de financiación objetivo El proyecto se financió a través de la siguiente ayuda:
ERC-CoG-2014: ERC Consolidator Grant
Cerrada hace 10 años
Presupuesto El presupuesto total del proyecto asciende a 2M€
Líder del proyecto
RUPRECHTKARLSUNIVERSITAET HEIDELBERG No se ha especificado una descripción o un objeto social para esta compañía.
Perfil tecnológico TRL 4-5