Hola,
¿eres nuevo aquí?

Regístrate gratis y conecta tu empresa con financiación pública, partners y proyectos.

Tengo cuenta

Regístrate

Ver video

GraViLa

Financiado

Cerrado

Graphs without Labels: Multimodal Structure Learning without Human Supervision

Multimodal learning focuses on training models with data in more than one modality, such as videos capturing visual and audio information or documents containing image and text. Current approaches use such data to train large-scal... ver más

31/03/2029

RHEINISCHE FRIEDRI...

1M€

Presupuesto del proyecto: 1M€

Líder del proyecto

RHEINISCHE FRIEDRICHWILHELMSUNIVERSITAT BONN No se ha especificado una descripción o un objeto social para esta compañía.

TRL 4-5

Fecha límite participación Sin fecha límite de participación.

Financiación concedida El organismo HORIZON EUROPE notifico la concesión del proyecto el día 2024-04-01

ERC-2023-STG: ERC STARTING GRANTS Scope:Objectives

I+D

Cerrada hace 2 años

0% 100%

Información adicional privada

No hay información privada compartida para este proyecto. Habla con el coordinador.

Participantes

RHEINISCHE FRIEDRICHWILHELMS...

Lider

Proyectos interesantes

IMAGINE

Artificial Inte...

Machine Learnin...

232K€ Cerrado

OPTGEN

Machine Learnin...

Artificial Inte...

1M€ Cerrado

RTI2018-102285-A-I00

Software

Data Science

28K€ Cerrado

PCIN-2015-251

Artificial Inte...

Machine Learnin...

88K€ Cerrado

PCIN-2015-226

Artificial Inte...

Natural Languag...

75K€ Cerrado

JOINTSTRUCTUREDPRED

Machine Learnin...

Data Science

154K€ Cerrado

Conecta tu I+D

¿Tienes un proyecto y buscas un partner? Gracias a nuestro motor inteligente podemos recomendarte los mejores socios y ponerte en contacto con ellos. Te lo explicamos en este video

Duración del proyecto: 59 meses Fecha Inicio: 2024-04-01
Fecha Fin: 2029-03-31

Líder del proyecto

RHEINISCHE FRIEDRICHWILHELMSUNIVERSITAT BONN No se ha especificado una descripción o un objeto social para esta compañía.

TRL 4-5

Presupuesto del proyecto 1M€

Fecha límite de participación Sin fecha límite de participación.

Descripción del proyecto Multimodal learning focuses on training models with data in more than one modality, such as videos capturing visual and audio information or documents containing image and text. Current approaches use such data to train large-scale deep learning models without human supervision by sampling pair-wise data e.g., an image-text pair from a website and train the network e.g. to identify matching vs. not matching pairs to learn better representations.We argue that multimodal learning can do more: by combining information from different sources, multimodal models capture cross-modal semantic entities, and as most multimodal documents are a collection of connected modalities and topics, multimodal models should allow us to capture the inherent high-level topology of such data. The goal of the following project is to learn semantic structures from multimodal data to capture long-range concepts and relations in multimodal data via multimodal and self-supervision learning without human annotation. We will represent this information in form of a graph, considering latent semantic concepts as nodes and their connectivity as edges. Based on this structure, we will extend current unimodal approaches to capture and process data from different modalities in a single structure. Finally, we will explore the challenges and opportunities of the proposed idea with respect to their impact on two main challenges in machine learning: data-efficient learning and fairness in label-free learning.By bridging the gap between those two parallel trends, multimodal supervision and graph-based representations, we combine their strengths of generating and processing topological data, which will not only allow to build new applications and tools but also opens new ways of processing and understanding large-scale data that are out-of-reach at the moment.

Conecta tu I+D

Entra hoy

¿Olvidé mi contraseña?

Financiación

Empresas

CTIs/Universidades

Proyectos

Investigadores