Hola,
¿eres nuevo aquí?

Registrate y conecta tu empresa con financiación pública, partners y proyectos.

Understanding DL

Financiado

Understanding Deep Learning

While extremely successful, deep learning (DL) still lacks a solid theoretical foundation. In the last 5 years the PI focused almost entirely on DL theory, yielding a strong publication record with 7 papers at NeurIPS (the leadin... ver más

31/08/2027

THE HEBREW UNIVERS...

1M€

Presupuesto del proyecto: 1M€

Líder del proyecto

THE HEBREW UNIVERSITY OF JERUSALEM No se ha especificado una descripción o un objeto social para esta compañía.

TRL 4-5

Financiación concedida El organismo HORIZON EUROPE notifico la concesión del proyecto el día 2022-04-04

Línea de financiación objetivo El proyecto se financió a través de la siguiente ayuda:

ERC-2021-STG: ERC STARTING GRANTS

I+D

Cerrada hace 3 años

0% 100% 100%

1 Participantes

THE HEBREW UNIVERSITY OF JER...

1.50M€ | Lider

Proyectos interesantes

DYNASTY Dynamics-Aware Theory of Deep Learning 1M€ Cerrado

NoKnow Not Knowing in Deep Representation Learning 2M€ Cerrado

TUCLA Theoretical Understanding of Classic Learning Algorithms 2M€ Cerrado

PID2021-127311NB-I00 BASES FISICAS DE LA INTELIGENCIA NATURAL: DE CELULAS A ORGAN... 145K€ Cerrado

Rand4TrustPool Random sampling for trustworthy pooling layers in graph neur... 227K€ Cerrado

BeyondBlackbox Data Driven Methods for Modelling and Optimizing the Empiric... 1M€ Cerrado

Últimas noticias

29-11-2024: IDAE En las últimas 48 horas el Organismo IDAE ha otorgado 4 concesiones

29-11-2024: ECE En las últimas 48 horas el Organismo ECE ha otorgado 2 concesiones

29-11-2024: CMVAMADRID En las últimas 48 horas el Organismo CMVAMADRID ha otorgado 37 concesiones

Duración del proyecto: 64 meses Fecha Inicio: 2022-04-04
Fecha Fin: 2027-08-31

Líder del proyecto

THE HEBREW UNIVERSITY OF JERUSALEM

TRL 4-5

Presupuesto del proyecto 1M€

Descripción del proyecto While extremely successful, deep learning (DL) still lacks a solid theoretical foundation. In the last 5 years the PI focused almost entirely on DL theory, yielding a strong publication record with 7 papers at NeurIPS (the leading ML conference), including 2 spotlights (top 3% of submitted papers) and one oral (top 1%), 2 papers at ICLR (the leading DL conference), and 1 paper at COLT (the leading ML theory conference). These results are amongst the first that break a 20 years hiatus in NN theory, thereby giving some hope for a solid deep learning theory. This includes 1) the first poly-time learnability result for non-trivial function class by SGD on NN, 2) the first such result with near optimal rate, 3) new methodology to bound the sample complexity of NN, that established the first sample complexity bound that is sublinear in the number of parameters, under norm constraints that are valid in practice, 4) an explanation to the phenomena of adversarial examples. We plan to go far beyond these and other results, and to build a coherent theory for DL, addressing all three pillars of learning theory: Optimization: We plan to investigate the success of SGD in finding a good model, arguably the greatest mystery of modern deep learning. Specifically our goal is to understand what models are learnable by SGD on neural networks. To this end, we plan to come up with a new class of models that can potentially lead to new deep learning algorithms, with a solid theory behind them. Statistical Complexity: We plan to crack the second great mystery of modern deep learning, which is their ability to generalize with fewer examples than parameters. Our plan is to investigate the sample complexity of classes of neural networks that are defined by bounds on the weights’ magnitude. Representation: We plan to investigate functions that can be realized by NN. This includes classical questions such as the benefits of depth, as well as more modern aspects such as adversarial examples.

Conecta tu I+D

Entra hoy

Financiación

Empresas

CTIs/Universidades

Proyectos

Investigadores