Hola,
¿eres nuevo aquí?

Registrate y conecta tu empresa con financiación pública, partners y proyectos.

FOUNDATIONS

Financiado

A Foundation for Empirical Multimodality Research

This project lays a foundation for conducting data-driven empirical research on multimodality, that is, how human communication and interaction rely on combinations of 'modes' of expression. Theories of multimodality are rapidly g... ver más

30/04/2029

HELSINGIN YLIOPIST...

2M€

Presupuesto del proyecto: 2M€

Líder del proyecto

HELSINGIN YLIOPISTO No se ha especificado una descripción o un objeto social para esta compañía.

TRL 4-5

Financiación concedida El organismo HORIZON EUROPE notifico la concesión del proyecto el día 2023-12-12

Línea de financiación objetivo El proyecto se financió a través de la siguiente ayuda:

ERC-2023-COG: ERC CONSOLIDATOR GRANTS

I+D

Cerrada hace 1 año

0% 100%

1 Participantes

HELSINGIN YLIOPISTO

2.00M€ | Lider

Proyectos interesantes

EIN2019-103441 MULTIMODAL HUMAN-DATA INTERACTION 10K€ Cerrado

PRE2020-094510 INTERACCION CORPORAL CON DATOS SEMANTICOS: INVESTIGANDO LAS... 99K€ Cerrado

PGC2018-097658-B-I00 CREATIME: CREATIVITY AND COGNITION IN THE EXPRESSION OF TIME... 48K€ Cerrado

PRE2018-083312 ANALISIS AFECTIVO DE INFORMACION MULTIMEDIA CON COMUNICACION... 93K€ Cerrado

PRE2018-083225 ANALISIS AFECTIVO DE INFORMACION MULTIMEDIA CON COMUNICACION... 93K€ Cerrado

TIN2010-21289-C02-02 SOFT COMPUTING, VISUALIZATION AND MULTIMODAL INTERACTION FOR... 79K€ Cerrado

Últimas noticias

27-11-2024: Videojuegos y creaci... Se abre la línea de ayuda pública: Ayudas para la promoción del sector del videojuego, del pódcast y otras formas de creación digital

27-11-2024: DGIPYME En las últimas 48 horas el Organismo DGIPYME ha otorgado 1 concesiones

27-11-2024: FUNDACION-EOI En las últimas 48 horas el Organismo FUNDACION EOI ha otorgado 2 concesiones

Duración del proyecto: 64 meses Fecha Inicio: 2023-12-12
Fecha Fin: 2029-04-30

Líder del proyecto

HELSINGIN YLIOPISTO

TRL 4-5

Presupuesto del proyecto 2M€

Descripción del proyecto This project lays a foundation for conducting data-driven empirical research on multimodality, that is, how human communication and interaction rely on combinations of 'modes' of expression. Theories of multimodality are rapidly gaining currency in diverse fields concerned with human communication, interaction and cultural production. However, most theories of multimodality are based on conjecture and remain without an empirical foundation due to the lack of large, richly-annotated multimodal corpora and methods for their analysis. FOUNDATIONS solves this problem by developing a novel methodology for conducting empirical research on multimodality in everyday cultural artefacts, such as newspapers, textbooks, magazines and social media videos. This methodology allows critically examining key theoretical concepts in the field – medium, semiotic mode and genre – and their joint contribution to meaning-making, which renews our understanding of key theoretical concepts in multimodality research and places their definitions on a solid empirical foundation. To do so, FOUNDATIONS creates large and reproducible multimodal corpora using microtask crowdsourcing, which breaks complex tasks into piecemeal work and distributes this effort to non-expert workers on online platforms. These crowdsourced descriptions are combined with computational representations into graphs that represent the structure of multimodal discourse. For analysing these corpora, the project develops novel methods based on neuro-symbolic artificial intelligence, which enables combining crowdsourced human insights with the pattern recognition capability of neural networks. The groundbreaking theoretical and methodological advances in FOUNDATIONS go far beyond state of the art by enabling large-scale empirical research while preserving analytical depth needed for multimodality research. This opens up new domains of inquiry for studying multimodality across cultures, situations, artefacts and timescales.

Conecta tu I+D

Entra hoy

Financiación

Empresas

CTIs/Universidades

Proyectos

Investigadores