Back to the future – data efficient language modeling
Abstract: Compute scaling has dominated the conversation with modern language models, leading to an impressive array of algorithms that optimize performance for a given training (and sometimes inference) compute budget. But as compute has grown cheaper and more abundant, data is starting to become a bottleneck, and our ability to exchange computing for data efficiency may be crucial to future model scaling. In this talk, I will discuss some of our recent work on synthetic data and algorithmic approaches to…
SES Admissions Q&A
Learn about the Social and Engineering Systems Doctoral Program by attending one of SES’s 2026 Admissions Q&A sessions. These are virtual question & answer sessions hosted by a member of the IDSS faculty as a follow-up to the pre-recorded SES Admissions Webinar. The SES Admissions Webinar (33 mins) should be viewed prior to attending the Q&A. Register!
TBD
TBD
TBD
TBD
SES Admissions Q&A
Learn about the Social and Engineering Systems Doctoral Program by attending one of SES’s 2026 Admissions Q&A sessions. These are virtual question & answer sessions hosted by a member of the IDSS faculty as a follow-up to the pre-recorded SES Admissions Webinar. The SES Admissions Webinar (33 mins) should be viewed prior to attending the Q&A. Registration opens November 13, 2025 at 5PM EST (-5 UTC).



