Lecture:
HIDA Lecture: Open Foundation Models
In this lecture, we show how scaling laws can be used to predict the performance of foundation models and to compare learning methods with high precision. We also introduce new approaches to measuring generalization that reveal hidden weaknesses in today’s models.