Formal analysis

We formalize aspects of language generation and develop theory and empirical analysis. Relevant work includes decoding algorithm consistency, mode recovery, and multi-step reasoning.

Consistency of language models with respect to incomplete decoding algorithms

Related publications


  1. Nouha Dziri, Ximing Lu, Melanie Sclar, and 13 more authors
    In Thirty-seventh Conference on Neural Information Processing Systems, Jul 2023


  1. Daniel Khashabi, Xinxi Lyu, Sewon Min, and 8 more authors
    In Proceedings of the 2022 Conference of the North American Chapter of the Association for Computational Linguistics: Human Language Technologies, Jul 2022


  1. Lang Liu, Krishna Pillutla, Sean Welleck, and 3 more authors
    In Advances in Neural Information Processing Systems, Jul 2021
  2. Ilia Kulikov, Sean Welleck, and Kyunghyun Cho
    In Proceedings of the 5th Workshop on Structured Prediction for NLP (SPNLP 2021), Aug 2021


  1. Sean Welleck, Ilia Kulikov, Jaedeok Kim, and 2 more authors
    In Proceedings of the 2020 Conference on Empirical Methods in Natural Language Processing (EMNLP), Nov 2020