ELIAS, ELLIOT & ELSA Theme Development Workshop on Foundation Models

Join us for the ELIAS, ELLIOT & ELSA Theme Development Workshop on Foundation Models, a 4-hour hybrid event designed to explore relevant technical challenges, consider legal & ethical aspects, and present application examples of Foundation Models.
10 July 2025

Date & Time: July 10th, 2025, 9:00 – 14:15 EEST (GMT+3)

Location: Centre for Research and Technology Hellas (CERTH), Thessaloniki, Greece (Hybrid Event)

Overview: The emergence of Foundation Models and Large Language Models is transforming the way AI systems are developed and applied in various industry sectors. Trained on massive amounts of data of different modalities and using transfer learning to apply the knowledge learned from one task to another, models such as ChatGPT, GPT-4, BERT, CLIP, DALL-E, etc. can be adapted to a wide range of downstream tasks from media content generation to climate change modeling, healthcare monitoring, autonomous driving and many more. 

The ELIAS, ELLIOT & ELSA Theme Development Workshop on Foundation Models aims to highlight the opportunities offered by Foundation Models, explore relevant technical challenges, consider legal & ethical aspects, and present application examples.

Objectives:

  • Explore technical aspects of Foundation Model training such as generalisation, scaling, benchmarking, security, and computational resources.
  • Address ethical considerations in the development and deployment of Foundation Models.
  • Highlight different applications domains and discuss relevant adaptation challenges of Foundation Models.

This hybrid 4-hour event will feature 3 sessions, each including 20-min keynote presentations from renowned experts in the field, followed by interactive discussions and a Q&A segment. Light lunch will be served after the end of the workshop.

Registration Deadlines
  • In-Person Attendance → June 15th, 2025 – 18:00 CET

  • Online Attendance → July 9th, 2025 – 18:00 CET

This workshop is jointly organised by the ELIAS, ELLIOT & ELSA projects.

ELLIOT – European Large Open Multi-Modal Foundation Models For Robust Generalization On Arbitrary Data Streams (GA No. 101214398 ) aims to enhance general-purpose AI by developing large-scale, open multimodal foundation models with strong spatio-temporal understanding. Led by top European academic and industrial labs from the ELLIS and LAION communities, the project targets underrepresented time-relevant modalities such as industrial time series, remote sensing, and health data. Both real and synthetic data will be used, sourced from consortium partners and European Data Spaces, with synthetic data generated using current and novel generative AI methods. European HPC resources are integrated to support large-scale model training.

ELSA – European Lighthouse on Secure and Safe AI (GA No. 101070617) is a growing network of excellence that spearheads efforts in foundational safe and secure AI methodology research. ELSA’s founding members include European experts in all aspects of safe and secure AI, with particular focus on technical robustness, privacy preserving techniques and human agency and oversight. In addition, ELSA brings on board research and industry experts in six different sectors that are key application areas of safe and secure AI. ELSA builds on and extends the internationally recognized and excellently positioned ELLIS (European Laboratory for Learning and Intelligent Systems) network of excellence.  For more information, please visit: www.elsa-ai.eu

Speakers & Moderators

Jenia Jitsev
Jenia Jitsev
JSC & LAION
EC projects: ELLIOT, openEuroLLM, LLMs4EU
Frank Hutter
Frank Hutter
PriorLabs & University of Freiburg
EC projects: ELLIOT, openEuroLLM, LLMs4EU
Cees Snoek
Cees Snoek
University of Amsterdam
EC projects: ELLIOT, ELIAS, ADRA-e
Mario Fritz
Mario Fritz
CISPA & Saarland University
EC projects: ELSA, ELLIOT
Flavia Giglio
Flavia Giglio
KU Leuven
EC projects: ELLIOT
Marc Pollefeys
Marc Pollefeys
ETH Zurich & Microsoft
EC projects: ELLIOT, ELIAS
Matthieu Cord
Matthieu Cord
Sorbonne University & VALEO
EC projects: ELLIOT
Dario Garcia-Gasulla
Dario Garcia-Gasulla
Barcelona Supercomputing Center
EC projects: ELLIOT, AI4Europe, AIFactories, DARE
Elisa Ricci
Elisa Ricci
University of Trento & Fondazione Bruno Kessler
ELIAS, ELLIOT
Lorenzo Baraldi
Lorenzo Baraldi
University of Modena and Reggio Emilia
ELIAS, ELLIOT, ELSA, MINERVA
Dimosthenis Karatzas
Dimosthenis Karatzas
CVC-CERCA & Autonomous University of Barcelona
ELSA, ELLIOT

Agenda

Please note that the agenda is subject to slight changes and will be updated accordingly.

All times are local (Greece) time (EEST = GMT+3, e.g. 10:00 EEST = 09:00 CEST)

Workshop Agenda
Time Duration Session Name
09:00 – 09:15 15 mins Welcome & Introduction to Foundation Models
  • Opening remarks
  • Introduction to Foundation Models
  • Overview of the sessions and objectives
Elisa Ricci (UNITN & FBK)
09:15 – 10:30 Session 1: Training Foundation Models
Moderator: Elisa Ricci (UNITN & FBK)
20 mins Keynote: Jenia Jitsev (JSC & LAION)
Open Foundation Models: Scaling Laws and Generalisation
To study transferable learning and generalisation, derivation of reproducible scaling laws is crucial, as they not only predict model function and properties on unseen scales, but also have potential to enable systematic comparison of various learning procedures. The talk will discuss why open foundation models and datasets are essential for this research and highlight challenges in properly measuring generalisation.
5 mins Q&A and Discussion
20 mins Keynote: Frank Hutter (PriorLabs, ELLIST)
Tabular Foundation Models
Tabular data, spreadsheets organized in rows and columns, are ubiquitous across healthcare, business and finance. Although deep learning has revolutionised learning from raw data and led to numerous high-profile success stories, gradient-boosted decision trees have dominated tabular data for the past 20 years. In this talk, I will demonstrate how we changed this with the first foundation models for tabular data, in particular TabPFN and TabPFN v2.
5 mins Q&A and Discussion
20 mins Keynote: Cees Snoek (UvA)
Teaching Diffusion Models to Count
Text-to-image diffusion models struggle to maintain numerical precision across varying object categories, count distributions, and visual domains. This talk will cover fine-tuning methods and evaluation benchmarks that enable diffusion models to count much more precisely.
5 mins Q&A and Discussion
10:30 – 11:20 Session 2: Ethical & Safe Foundation Models
Moderator: Lorenzo Baraldi (UNIMORE)
20 mins Keynote: Mario Fritz (CISPA)
Security and Safety of Foundation Models
The talk will focus on the security and safety of Foundation Models, covering topics such as LLM security, prompt injection, data-instruction separation, multi-agent setups, AI for (vulnerable) code, and auto red teaming.
5 mins Q&A and Discussion
20 mins Keynote: Flavia Giglio (KUL)
Ethical and Legal Aspects of Foundation Models
The talk will revolve around legal and ethical challenges posed by foundation models, including an overview of the latest EU legislative developments in the AI field and how it concerns the design and deployment of such models.
5 mins Q&A and Discussion
11:20 – 11:40 COFFEE BREAK
11:40 – 12:55 Session 3: Application of Foundation Models
Moderator: Dimosthenis Karatzas (CVC-CERCA & UAB)
20 mins Keynote: Marc Pollefeys (Microsoft & ETHZ)
Spatial AI
The talk will focus on the challenges of using AI in 3D spatial settings for real-world AI assistants and robotics.
5 mins Q&A and Discussion
20 mins Keynote: Matthieu Cord (VALEO)
Driving through Generative Video Pretraining
Presentation of an end-to-end driving Video-Action Model that harnesses the power of generative video pretraining, learning unsupervised rich video representations from large driving video datasets and applying these representations for control via imitation learning.
5 mins Q&A and Discussion
20 mins Keynote: Dario Garcia-Casulla (BSC)
Training and Evaluating LLMs in European HPC centers
Review of current practices on post-training LLMs (SFT, instruct, merge and align) for multiple tasks in healthcare, and discussion of current limitations in model evaluation, also for other domains such as LLMs for Chip Design or code generation. Includes details of computational access and cost within existing and incoming (AIFactories) European HPC infrastructure.
5 mins Q&A and Discussion
12:55 – 13:15 20 mins Conclusion & Wrap-up
  • Summary of key takeaways
  • Final remarks and next steps
Elisa Ricci (UNITN & FBK), Dimosthenis Karatzas (CVC-CERCA & UAB), Lorenzo Baraldi (UNIMORE)
13:15 – 14:15 60 mins LUNCH
Registration & Participation

Participation is free, but registration is required. Once registered, participants will receive further event details.

Registration deadlines:
June 15th, 2025, 18:00 CET – for in-person attendance
July 9th, 2025, 18:00 CET – for online attendance

We don’t spam! Read our Privacy Policy Events for more info.

How will you participate?
Pursuant to art. 13 of EU Regulation No. 2016/679 (GDPR), we inform you that your personal data shall be processed for the registration and participation in the event. Privacy Policy available at the following link https://elias-ai.eu/privacy-policy-events/.
This field is required.

Venue

The ELIAS, ELLIOT & ELSA TDW on Foundation Mode will take place at the campus of the Centre for Research and Technology Hellas (CERTH) in Thessaloniki, Greece. CERTH is located at the 6th km of the Charilaou-Thermi Road in Thermi, Thessaloniki. It is about 10 km from the centre of Thessaloniki and about 8 km from “Makedonia” International airport. You can reach CERTH by bus/metro, car or taxi.

The workshop will take place at the Amphitheatre of the central administration building of CERTH. Coffee and lunch breaks will take place in the entrance hall (foyer), outside the Amphitheatre. As you enter the campus, the central administration building is on your right, the last building with the red bricks at the end of the road (<1 min walk from the gate). You can always ask the guard at the gate of the campus for instructions. Signs will also be put out.

Upcoming Events