BEGIN:VCALENDAR
VERSION:2.0
PRODID:-//Computer Science and Engineering - ECPv6.13.0//NONSGML v1.0//EN
CALSCALE:GREGORIAN
METHOD:PUBLISH
X-ORIGINAL-URL:https://homecse.iitd.ac.in
X-WR-CALDESC:Events for Computer Science and Engineering
REFRESH-INTERVAL;VALUE=DURATION:PT1H
X-Robots-Tag:noindex
X-PUBLISHED-TTL:PT1H
BEGIN:VTIMEZONE
TZID:Asia/Kolkata
BEGIN:STANDARD
TZOFFSETFROM:+0530
TZOFFSETTO:+0530
TZNAME:IST
DTSTART:20250101T000000
END:STANDARD
END:VTIMEZONE
BEGIN:VEVENT
DTSTART;TZID=Asia/Kolkata:20251212T110000
DTEND;TZID=Asia/Kolkata:20251212T120000
DTSTAMP:20261010T162627
CREATED:20251207T103353Z
LAST-MODIFIED:20251207T103353Z
UID:2230-1765537200-1765540800@homecse.iitd.ac.in
SUMMARY:Relational Transformer: Toward Zero-Shot Foundation Models for Relational Data by Rishabh Ranjan
DESCRIPTION:Venue: Bharti501 \nAbstract: Pretrained transformers readily adapt to new sequence modeling tasks via zero-shot prompting\, but relational domains still lack architectures that transfer across datasets and tasks. The core challenge is the diversity of relational data\, with varying heterogeneous schemas\, graph structures and functional dependencies. In this talk\, I will present the Relational Transformer (RT) architecture\, which can be pretrained on diverse relational databases and directly applied to unseen datasets and tasks without task- or dataset-specific fine-tuning\, or retrieval of in-context examples. RT (i) tokenizes cells with table/column metadata\, (ii) is pretrained via masked token prediction\, and (iii) utilizes a novel Relational Attention mechanism over columns\, rows\, and primary-foreign key links. Pretrained on RelBench datasets spanning tasks such as churn and sales forecasting\, RT attains strong zero-shot performance\, averaging 93% of fully supervised AUROC on binary classification tasks with a single forward pass of a 22M parameter model\, as opposed to 84% for a 27B LLM. Fine-tuning yields state-of-the-art results with high sample efficiency. Our experiments show that RT’s zero-shot transfer harnesses task-table context\, relational attention patterns and schema semantics. Overall\, RT provides a practical path toward foundation models for relational data. https://arxiv.org/abs/2510.06377 \nBio: Rishabh Ranjan is a 3rd year PhD student at Stanford University co-advised by Jure Leskovec and Carlos Guestrin and supported by the Amazon Core AI Fellowship. His research is on building foundation models for relational data\, which includes databases\, tables\, time series and graphs. Before Stanford\, he has spent time at CMU and IIT Delhi\, where he was the President’s Gold Medalist for 2022. https://rishabh-ranjan.github.io
URL:https://homecse.iitd.ac.in/event/relational-transformer-toward-zero-shot-foundation-models-for-relational-data-by-rishabh-ranjan/
LOCATION:Bharti 501\, IIT Campus\, Hauz Khas\, New Delhi
END:VEVENT
END:VCALENDAR