scientifyRESEARCH
research funding database

RESEARCH FUNDING

Global Challenge For Safe And Secure LLMs (worldwide)

Share this post

Text on a blue background says "Want to find funding & get support for grant-writing?" Logos of scientifyRESEARCH & GrantDesk appear below on a white background and an orange plus symbol appears between the two logos.
Text on a blue background says "Want to find funding & get support for grant-writing?" Logos of scientifyRESEARCH & GrantDesk appear below on a white background and an orange play symbol appears between the two logos. An arrow mark points to the logos.

The Global Challenge For Safe And Secure Large Language Models (LLMs) from AI Singapore and the CyberSG R&D Programme Office (CRPO) aims to advance AI research in developing robust security measures and innovative approaches to mitigate jailbreaking attacks on LLMs. The goal is to foster safer AI interactions worldwide, particularly in applications with significant societal impact. Applications are open to researchers and industry professionals worldwide; and to individuals interested in AI Security and Safety with experience in Natural Language Processing, Machine Learning, and AI Model Robustness. The 8-month competition is divided into two tracks: Attack and Defense. Participants can choose to join either or both tracks. Participation in Track 1 is not required for Track 2.

  • Track 1 (Attack): Participants will innovate by creating automated approaches for crafting test cases (prompts) designed to trigger a range of undesirable responses from a series of fine-tuned LLMs despite their training to prevent such outcomes. The focus will be on 75 predefined behaviours categorized under themes such as prejudice, violence, illegal activities, fraudulent schemes, and misinformation.
  • Track 2 (Defense): Participants will develop robust security measures to reinforce the resilience of LLMs against the advanced jailbreak attacks demonstrated in Track 1.

The prize awards range from 7,500 USD to 30,000 USD (First Place) on Track 1. And from 10,000 USD to 40,000 USD (First Place) on Track 2.
The top ten teams in each track will be provided a travel stipend of 2,000 USD for one representative per team to attend the respective tracks’ Prize Ceremonies.

Submission deadline for Track 1A is August 6, 2024. Submission for Track 1B opens on August 20, 2024, and closes on September 17, 2024.

Adverts. Premium members do not see Google Ads.

Please Login / Subscribe to our premium membership to see the content. Sign up to Free trial to see detailed funding information.

non member

Sign-up for the
scientifyRESEARCH
monthly funding newsletter

unsubscribe at any time