BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Computer Science and Engineering - ECPv6.13.0//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://homecse.iitd.ac.in
X-WR-CALDESC:Events for Computer Science and Engineering
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:Asia/Kolkata
BEGIN:STANDARD
TZOFFSETFROM:+0530
TZOFFSETTO:+0530
TZNAME:IST
DTSTART:20250101T000000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=Asia/Kolkata:20250808T120000
DTEND;TZID=Asia/Kolkata:20250808T130000
DTSTAMP:20261012T031107
CREATED:20250804T083721Z
LAST-MODIFIED:20250804T083759Z
UID:1754-1754654400-1754658000@homecse.iitd.ac.in
SUMMARY:Multiturn Evals (and RL) for LLMs by Kartikeya Badola
DESCRIPTION:Title: Multiturn Evals (and RL) for LLMs \nDetails: 8th August\, 12 pm\, SIT001 \nAbstract: LLMs often fail at multi-step tasks requiring memory and strategic planning\, a gap not captured by traditional single-turn evals. To address this\, we’ve developed a suite of human and automated evals that stress test Gemini on these capabilities. This talk will cover the motivation and design behind these evals\, a discussion on latest results and will also touch upon some of the early promising experiments using multiturn RL methods to address some of these losses. \nBio: Kartikeya Badola is a Software Engineer at Google DeepMind in London\, where he works with the Gemini evals and Gemini thinking teams. Prior to this\, he was with Google Research in India\, working on multilingual semantic parsing. Kartikeya is a graduate of IIT Delhi\, where he worked with Prof. Mausam and Prof. Parag Singla on Distantly Supervised Relation Extraction. \n 
URL:https://homecse.iitd.ac.in/event/multiturn-evals-and-rl-for-llms-by-kartikeya-badola/
LOCATION:SIT 001\, Amar Nath and Shashi Khosla School of Information Technology\, IIT Delhi\, Hauz Khas\, New Delhi 110016\, India\, Delhi\, Delhi\, 110016\, India
END:VEVENT
END:VCALENDAR