Advancing AI Frontiers: Exploring Multimodal Foundation Models at ELLIS Workshop

Advancing AI Frontiers: Exploring Multimodal Foundation Models at ELLIS Workshop

Advancing AI Frontiers: Exploring Multimodal Foundation Models at ELLIS Workshop

ELIAS Consortium Members Engage in Cutting-Edge Exploration of Multimodal Foundation Models at ELLIS Workshop

The ELIAS Project Coordinator Niculae Sebe and Consortium Member Cees Snoek, both directors of the ELLIS Program on Multimodal Learning Systems, lead discourse on advancements in Multimodal Learning Systems.

January 17  19, 2024, Oberwolfach-Walke, Germany In a groundbreaking event, members of the European Lighthouse of AI for Sustainability (ELIAS) consortium gathered at the Mathematisches Forschungsinstitut Oberwolfach (MFO) in Oberwolfach-Walke, Germany, for an important workshop focusing on Multimodal Foundation Models. The workshop, organised by ELIAS Coordinator Niculae Sebe and Consortium Member Cees Snoek, both directors of the ELLIS Program on Multimodal Learning Systems, sought to delve into the intricacies of this paradigm-shifting facet of artificial intelligence.

Workshop Deliberations: At the epicenter of the discussions were Multimodal Foundation Models, a paradigmatic class of artificial intelligence models renowned for their prowess in synthesizing multifaceted content, ranging from textual information to images, sound, and videos, often via interactive prompts. Models such as ChatGPT, Stable Diffusion, Gemini, and GPT4 were scrutinised for their perceived intelligence, adaptability, and, notably, the ethical concerns associated with their capacity to produce potentially misleading information. The workshop facilitated an international assembly of researchers from both academia and industry to scrutinise recent advancements, deliberate on their impact, and envisage future implications.

ELLIS Workshop_1
ELLIS Workshop_4
ELLIS Workshop_5

The ELIAS Project Coordinator Niculae Sebe and Consortium Member Cees Snoek, leading figures in the ELLIS Program Multimodal Learning Systems, guided the discussions throughout the workshop. Their leadership underscored the collaborative efforts propelled by ELLIS Programs, fostering interdisciplinary engagements across European scientific communities to propel the frontiers of artificial intelligence.

ELLIS Workshop_6

The ELIAS Project Coordinator Niculae Sebe and Consortium Member Cees Snoek, leading figures in the ELLIS Program Multimodal Learning Systems, guided the discussions throughout the workshop. Their leadership underscored the collaborative efforts propelled by ELLIS Programs, fostering interdisciplinary engagements across European scientific communities to propel the frontiers of artificial intelligence.

ELLIS Workshop_6

In-Depth Program Structure: The workshop unfolded through meticulously structured sessions, encompassing Foundation Models, Vision & Language, Generative AI, and Multimodality. Renowned experts, including Karteek Alahari, Cristian Sminchisescu, Xavier Alameda-Pineda, Elisa Ricci, Hakan Bilen, Shaogang Gong, Jakob Verbeek, Juergen Gall, Ioannis Patras, Dima Damen, and Dimosthenis Karatzas, shared their insights and research findings.

European Union’s Scientific Support: This scientific endeavor received financial backing from the European Lab for Learning and Intelligent Systems (ELLIS), aligning with the European Union’s Horizon 2020 research and innovation programme under grant agreement No 951847, known as ELISE – European Network of AI Excellence Centres.

Future Trajectory: The fruitful discussions and presentations at the workshop are expected to pave the way for further advancements in the field of Multimodal Foundation Models. The collaborative efforts of ELIAS and ELLIS Programs continue to drive progress in artificial intelligence, ensuring its responsible and sustainable development.

For more information:

For a detailed breakdown of the workshop’s scientific program, refer to The ELLIS Multimodal Learning Systems Workshop on Multimodal Foundation Models

For a broader understanding of the ongoing initiatives and endeavors within the ELLIS Program, we invite you to explore the full spectrum of activities at ELLIS Programs.

 

#Opportunity: Postdoctoral Researcher in AI for Sustainability – University of Amsterdam (UvA)

#Opportunity: Postdoctoral Researcher in AI for Sustainability – University of Amsterdam (UvA)

Postdoctoral Researcher in AI for Sustainability at the University of Amsterdam

Amsterdam Machine Learning Lab (AMLab)

Duration: 2 years (starting winter 2024)

The University of Amsterdam (UvA) is recruiting a postdoctoral researcher in AI for sustainability. AI has a tremendous potential for accelerating the development of sustainable technologies. Realising this potential requires fundamental research to develop new AI methods for the design and modelling of physical systems as well as translational research to adapt inventions to practical use cases.

This work contributes to the European Lighthouse of AI for Sustainability (ELIAS). ELIAS will accelerate the development of AI-driven methods for computational design, data-driven simulations, as well as the development of neural networks for fast approximation of scientific computations (e.g., to accelerate climate simulations). ELIAS will also focus on devising new approaches for reducing the energy requirements of AI systems. 

Responsibilities

  • Develop AI methods for computational design, by combining techniques for:
    • Bayesian optimisation and experiment design;
    • Probabilistic programming and simulation-based inference;
    • Development of data-efficient neural surrogate models;
  • Present your research by contributing to international conferences, workshops, and journals;
  • Actively participate in activities for the ELIAS and ELLIS networks;
  • Assist in teaching activities: teaching courses; supervising master and PhD students.

Qualifications

  • PhD in Machine Learning, Statistics, Computer Science, Mathematics, or a related field;
  • Experience in programming and software development. Familiarity with Python and statistical computing libraries (e.g. NumPy, PyTorch, JAX) is preferred;
  • Enthusiasm for the scientific process: formulating and conducting experiments, data collection and analysis, disseminating findings via writing and oral presentations;
  • Ability to cooperate and work effectively within a team;
  • Fluency in English, both written and spoken.

Offer

UvA offers a temporary employment contract for 38 hours per week for a period of 24 months. The preferred starting date is as soon as possible.

The gross monthly salary, based on 38 hours per week and dependent on relevant experience, ranges between € 3,226 to € 5,090 (scale 10). UvA additionally offers an extensive package of secondary benefits, including 8% holiday allowance and a year-end bonus of 8.3%. The UFO profile Researcher 4 is applicable. A favourable tax agreement, the ‘30% ruling’, may apply to non-Dutch applicants. The Collective Labour Agreement of Universities of the Netherlands is applicable.

 Besides the salary and a vibrant and challenging environment at Science Park, UvA offer you multiple fringe benefits:

  • 232 holiday hours per year (based on fulltime) and extra holidays between Christmas and 1 January;
  • Multiple courses to follow from our Teaching and Learning Centre;
  • Multiple courses on topics such as leadership for academic staff;
  • Multiple courses on topics such as time management, handling stress and an online learning platform with 100+ different courses;
  • 7 weeks birth leave (partner leave) with 100% salary;
  • Partly paid parental leave;
  • The possibility to set up a workplace at home;
  • A pension at ABP for which UvA pays two third part of the contribution;
  • The possibility to follow courses to learn Dutch;
  • Help with housing for a studio or small apartment when you’re moving from abroad.

About UvA

The University of Amsterdam (UvA) is the Netherlands’ largest university, offering the widest range of academic programmes. At the UvA, 42,000 students, 6,000 staff members and 3,000 PhD candidates study and work in a diverse range of fields, connected by a culture of curiosity.

 The Faculty of Science (FNWI) has a student body of around 8,000, as well as 1,800 members of staff working in education, research or support services. Researchers and students at the Faculty of Science are fascinated by every aspect of how the world works, be it elementary particles, the birth of the universe or the functioning of the brain.

 The mission of the Informatics Institute (IvI) is to perform curiosity-driven and use-inspired fundamental research in Computer Science. The main research themes are Artificial Intelligence, Computational Science and Systems and Network Engineering. The research involves complex information systems at large, with a focus on collaborative, data driven, computational and intelligent systems, all with a strong interactive component.

 You will be working within the Amsterdam Machine Learning Lab (AMLab) which conducts research in the area of large scale modelling of complex data sources. This includes the development of new methods for probabilistic graphical models and non-parametric Bayesian models, the development of faster (approximate) inference and learning methods, deep learning, causal inference, reinforcement learning and multi-agent systems and the application of all of the above to large scale data domains in science and industry (‘Big Data problems’). AMLab is co-directed by Max Welling and Jan-Willem van de Meent. AMLab positions itself in the AI research theme, and also with clear links to the Data Science theme of the Informatics Institute.

How to apply:

Interested candidates should submit their application in a single PDF by 04.02.2024 including the following information:

  • A curriculum vitae, including a list of publications (with hyperlinks);
  • A research statement describing your interests and research trajectory;
  • The names and contact information of at least two academic references (please do not include the letters themselves);
  • Optional: A letter providing any additional information not sufficiently highlighted by the other materials. For instance, the letter could describe how Covid-19 has affected productivity.

You can use the CV field to upload your resume as a separate pdf document. Use the Cover Letter field to upload the other requested documents, including the motivation letter, as one single pdf file.

 A knowledge security check can be part of the selection procedure.
(for details: National knowledge security guidelines).

Need more details or have questions?

Contact: Jan-Willem van de Meent, Associate Professor (UHD)

✉️ Email: j.w.vandemeent@uva.nl

The new ELLIS call for Fellows & Scholars is open!

The new ELLIS call for Fellows & Scholars is open!

The new ELLIS call for Fellows & Scholars is open!

How to apply:

The deadline for nominations is 1 March 2024. Please note that nominations are only possible through the directors of ELLIS Programs and ELLIS Units – people interested in applying should therefore contact the respective directors directly.

You will find more information about the guidelines for evaluating scientific excellence for Fellow/Scholar nominations here.

#Opportunity: Postdoctoral Position on Multimodal Narrative Analysis at the University of Copenhagen

#Opportunity: Postdoctoral Position on Multimodal Narrative Analysis at the University of Copenhagen

Postdoctoral position on Multimodal Narrative Analysis 

Duration: 2 years (starting September 2024)

The Department of Computer Science  (DIKU) at the University of Copenhagen

The Department of Computer Science  (DIKU) at the University of Copenhagen invites application for a 2-year postdoctoral full-time research position in the domain of Machine Learning for narrative analysis, drawing upon methods from NLP and Computer Vision.

We are looking for a candidate with a solid background in Machine Learning and intellectual curiosity in fact-checking, deep-fakes, and/or disinformation. Knowledge in topic modeling, argument mining, visual question answering, and sentiment analysis is a plus. Successful candidates must have demonstrated their ability to publish in top tier venues, such as NeurIPS, ICLR, CVPR, and/or EMNLP.

Inquiries about the position can be made to Prof. Serge Belongie, sjb@aicentre.dk

The position is for 24 months and open from 1 September 2024, or as soon as possible thereafter.

The University wishes our staff to reflect the diversity of society and thus welcomes applications from all qualified candidates regardless of personal background.

Working environment

The research is part of the Horizon Europe European Lighthouse of AI for Sustainability (ELIAS) project and will be conducted in collaboration with researchers at the Pioneer Centre for Artificial Intelligence.

You will be part of both the Pioneer Centre for AI and DIKU, offering a vibrant, international research community working across disciplines. DIKU is a member of the ELLIS unit Copenhagen, and Prof. Belongie is an ELLIS Fellow and Board Member. DIKU and the Pioneer Centre for AI offer its researchers generous support for career development, own fundraising, travel, and visitors, as well as support for and access to computing facilities.

International applicants

The University of Copenhagen offers international researchers and their families a broad variety of services, such as support before and during relocation and career counselling to expat partners. Most international candidates qualify for a special foreign-researcher-tax scheme. Please find more information about these services as well as practical information on entering and working in Denmark here:https://ism.ku.dk/.

Copenhagen is continuously ranked among the top-5 livable cities in the world with clean air, beautiful architecture, a rich cultural life and dedication to work-life balance and “hygge”. Employees are offered 6-weeks of vacation annually, generous parental leave and Copenhagen offers great childcare facilities, international schools and is a very family-friendly city.

Terms of employment

The position is covered by the Memorandum on Job Structure for Academic Staff.

Terms of appointment and payment accord to the agreement between the Ministry of Finance and The Danish Confederation of Professional Associations on Academics in the State.

Negotiation for salary supplement is possible.

How to apply:

The application, in English, must be submitted electronically by clicking APPLY NOW below. Please include:

  • Curriculum vitae
  • Diplomas (copy of Master and PhD degree certificate or equivalent)
  • Research plan – description of current and future research plans
  • Complete publication list

The deadline for applications is 1 February 2024, 23:59 GMT +1.

After the expiry of the deadline for applications, the authorized recruitment manager selects applicants for assessment on the advice of the Interview Committee.

Interviews will be held in early March.

You can read about the recruitment process at http://employment.ku.dk/faculty/recruitment-process/

#ADRF23: A Glimpse into the World of AI Networks of Excellence

#ADRF23: A Glimpse into the World of AI Networks of Excellence

#ADRF23: A Glimpse into the World of AI Networks of Excellence

AI, Data, Robotics Forum 2023: Generative AI for European society and industry

8-9 November 2023, Inria HQ, Versailles

The much-anticipated AI, Data, Robotics Forum 2023 (ADRF23) is just around the corner, and it promises to provide a holistic perspective on the realm of AI Networks of Excellence. This remarkable event is scheduled to kick off on November 8th in Versailles, this event will bring together some of the brightest minds and most influential players in the field of AI and robotics.

ELIAS will also be presented together with  standing alongside other prestigious European Networks of Excellence in AI & Robotics!

The European Networks of Excellence Centres in AI and Robotics will have their first joint booth – search for an unmistakable blue-coloured design in the “RENOIR” exhibition area at the ADR Forum. 

This remarkable collaboration has been made possible thanks to the VISION project, which is generously facilitating and sponsoring a joint presentation. For the first time, AI Networks of Excellence will unite under a common visual identity for AI NoE, resulting in a dedicated booth at ADRF23, as the Gold Partner of the ADRF 2023.

ADRF23, known as the “AI, Data, Robotics Forum 2023,” is designed to shed light on the advancements in Generative AI for European society and industry. It serves as the perfect stage for the “AI NoE” Community to make its mark while attracting key stakeholders from the Adra – AI-Data-Robotics-Association ecosystem including European Commission representatives.

    Join us on 8 and 9 November in the Inria Headquarters in Versailles and seize the opportunity to connect with members of our community, especially – but not only – during the breaks:

    8 November: 11:25-11:50, 13:30-14:15, 15:45-16:00

    9 November: 10:15-10:45, 13:00-13:30, 15:00-15:30

    Do not miss the chance to be part of this extraordinary convergence of AI excellence at ADRF23, where innovation, collaboration, and the future of trustworthy AI take center stage

    More information: