| Roberta: A robustly optimized bert pretraining approach Y Liu, M Ott, N Goyal, J Du, M Joshi, D Chen, O Levy, M Lewis, ... arXiv preprint arXiv:1907.11692, 2019 | 31558* | 2019 |
| Deep contextualized word representations ME Peters, M Neumann, M Iyyer, M Gardner, C Clark, K Lee, ... NAACL, 2018 | 16589* | 2018 |
| Bart: Denoising sequence-to-sequence pre-training for natural language generation, translation, and comprehension M Lewis arXiv preprint arXiv:1910.13461, 2019 | 12091 | 2019 |
| Unsupervised cross-lingual representation learning at scale A Conneau arXiv preprint arXiv:1911.02116, 2019 | 6864 | 2019 |
| Opt: Open pre-trained transformer language models S Zhang, S Roller, N Goyal, M Artetxe, M Chen, S Chen, C Dewan, ... arXiv preprint arXiv:2205.01068, 2022 | 3679* | 2022 |
| Triviaqa: A large scale distantly supervised challenge dataset for reading comprehension M Joshi, E Choi, DS Weld, L Zettlemoyer arXiv preprint arXiv:1705.03551, 2017 | 2393 | 2017 |
| Qlora: Efficient finetuning of quantized llms T Dettmers, A Pagnoni, A Holtzman, L Zettlemoyer Advances in Neural Information Processing Systems 36, 2024 | 2343 | 2024 |
| Spanbert: Improving pre-training by representing and predicting spans M Joshi, D Chen, Y Liu, DS Weld, L Zettlemoyer, O Levy Transactions of the association for computational linguistics 8, 64-77, 2020 | 2334 | 2020 |
| Multilingual denoising pre-training for neural machine translation Y Liu arXiv preprint arXiv:2001.08210, 2020 | 1950 | 2020 |
| Toolformer: Language models can teach themselves to use tools T Schick, J Dwivedi-Yu, R Dessė, R Raileanu, M Lomeli, E Hambro, ... Advances in Neural Information Processing Systems 36, 68539-68551, 2023 | 1478 | 2023 |
| Allennlp: A deep semantic natural language processing platform M Gardner, J Grus, M Neumann, O Tafjord, P Dasigi, N Liu, M Peters, ... arXiv preprint arXiv:1803.07640, 2018 | 1459 | 2018 |
| Rethinking the role of demonstrations: What makes in-context learning work? S Min, X Lyu, A Holtzman, M Artetxe, M Lewis, H Hajishirzi, L Zettlemoyer arXiv preprint arXiv:2202.12837, 2022 | 1284 | 2022 |
| Knowledge-based weak supervision for information extraction of overlapping relations R Hoffmann, C Zhang, X Ling, L Zettlemoyer, DS Weld Proceedings of the 49th annual meeting of the association for computational …, 2011 | 1264 | 2011 |
| End-to-end neural coreference resolution K Lee, L He, M Lewis, L Zettlemoyer arXiv preprint arXiv:1707.07045, 2017 | 1205 | 2017 |
| Learning to map sentences to logical form: Structured classification with probabilistic categorial grammars LS Zettlemoyer, M Collins Conference on Uncertainty in Artificial Intelligence (UAI), 2005 | 1174* | 2005 |
| QuAC: Question answering in context E Choi, H He, M Iyyer, M Yatskar, W Yih, Y Choi, P Liang, L Zettlemoyer arXiv preprint arXiv:1808.07036, 2018 | 983 | 2018 |
| Gpt3. int8 (): 8-bit matrix multiplication for transformers at scale T Dettmers, M Lewis, Y Belkada, L Zettlemoyer Advances in Neural Information Processing Systems 35, 30318-30332, 2022 | 964 | 2022 |
| Lima: Less is more for alignment C Zhou, P Liu, P Xu, S Iyer, J Sun, Y Mao, X Ma, A Efrat, P Yu, L Yu, ... Advances in Neural Information Processing Systems 36, 2024 | 903 | 2024 |
| Summarizing source code using a neural attention model S Iyer, I Konstas, A Cheung, L Zettlemoyer 54th Annual Meeting of the Association for Computational Linguistics 2016 …, 2016 | 889 | 2016 |
| Generalization through memorization: Nearest neighbor language models U Khandelwal, O Levy, D Jurafsky, L Zettlemoyer, M Lewis arXiv preprint arXiv:1911.00172, 2019 | 848 | 2019 |
Mike LewisFacebook AI ResearchVerified email at fb.com
