Hola,
Are you new here?

I have an account

Conecta con

+150K Projects

+300K Companies

+230 Financiaciones

¿Te ayudamos?

Ejemplos de búsqueda

Vídeos Explicativos

DECOLLAGE

financed

Closed

DEep COgnition Learning for LAnguage GEneration

In recent years, transformer-based deep learning models such as BERT or GPT-3 have led to impressive results in many natural language processing (NLP) tasks, exhibiting transfer and few-shot learning capabilities. However, despit... see more

31/07/2028

2M€

Project Budget: 2M€

Project leader

INSTITUTO DE TELECOMUNICACOES No se ha especificado una descripción o un objeto social para esta compañía.

TRL 4-5

PARTICIPATION DEPralty Sin fecha límite de participación.

Ver 2 Participantes

Financing granted El organismo HORIZON EUROPE notifico la concesión del proyecto The day 2023-04-05

ERC-2022-COG: ERC CONSOLIDATOR GRANTS Scope:Objectives

I+D

Cerrada

0% 100% 100%

characteristics of the participant

Este proyecto no cuenta con búsquedas de partenariado abiertas en este momento.

Private Information

No hay información privada compartida para este proyecto. Habla con el coordinador.

2 Participantes

1.79M€ | Leader

Unbabel

209.38K€ | participant

Conecta tu I+D

¿Tienes un proyecto y buscas un partner? Gracias a nuestro motor inteligente podemos recomendarte los mejores socios y ponerte en contacto con ellos. Te lo explicamos en este video

Project duration: 63 months Date Start: 2023-04-05
End date: 2028-07-31

Project leader

INSTITUTO DE TELECOMUNICACOES No se ha especificado una descripción o un objeto social para esta compañía.

TRL 4-5

Project Budget 2M€

participation deadline Sin fecha límite de participación.

Project description In recent years, transformer-based deep learning models such as BERT or GPT-3 have led to impressive results in many natural language processing (NLP) tasks, exhibiting transfer and few-shot learning capabilities. However, despite faring well in benchmarks, current deep learning models for NLP often fail badly in the wild: they are bad at out-of-domain generalization, they do not exploit contextual information, they are poorly calibrated, and their memory is not traceable. These limitations stem from their monolithic architectures, which are good for perception, but unsuitable for tasks requiring higher-level cognition. In this project, I attack these fundamental problems by bringing together tools and ideas from machine learning, sparse modeling, information theory, and cognitive science, in an interdisciplinary approach. First, I will use uncertainty and quality estimates for utility-guided controlled generation, combining this control mechanism with the efficient encoding of contextual information and integration of multiple modalities. Second, I will develop sparse and structured memory models, together with attention descriptive representations towards conscious processing. Third, I will build mathematical models for sparse communication (reconciling discrete and continuous domains), supporting end-to-end differentiability and enabling a shared workspace where multiple modules and agents can communicate. I will apply the innovations above to highly challenging language generation tasks, including machine translation, open dialogue, and story generation. To reinforce interdisciplinarity and maximize technological impact, collaborations are planned with cognitive scientists and with a scale-up company in the crowd-sourcing translation industry.

Conecta tu I+D

Entra hoy

Forgot your password?

Financing

Companies

CTIs/Universidades

Projects

researchers

What is innovating.Works? Lose yourself in the best search engine for innovative companies you've ever seen, see how your competition is funded, connect with that partner you didn't know about, discover R&D projects that need you, and much, much more just a click away.

Smart Company-Financial Motor Innovating tiene un perfil tecnológico financiero de 400.000 empresas gracias al cual sabe a qué ayuda puede ir o no cualquier empresa de forma automática. Parece magia pero es tecnología.

Create your project and find partners ¿Tienes un proyecto y buscas un partner? Una Universidad, Centro Tecnológico, Consultoría? Este es tu sitio. Gracias al motor de búsqueda podemos recomendarte los mejores socios y ponerte en contacto con ellos.