Generalization

We aim to understand how language models generalize, including out-of-distribution generalization in formal reasoning and the role of memorization. Examples include Symbolic Brittleness, Limits of Transformers, and Llemma.

Related publications

2023

  1. Zhangir Azerbayev, Hailey Schoelkopf, Keiran Paster, and 6 more authors
    arXiv preprint arXiv:2310.06786, Nov 2023
  2. Nouha Dziri, Ximing Lu, Melanie Sclar, and 13 more authors
    In Thirty-seventh Conference on Neural Information Processing Systems, Nov 2023

2021

  1. Sean Welleck, Peter West, Jize Cao, and 1 more author
    In AAAI Conference on Artificial Intelligence, Nov 2021