Limitations in Language Models
I’ve identified key limitations in today’s language models:
- Language models produce worse multidocument summaries when provided retrieved documents (EMNLP Findings 2023),
- Standard prompting strategies result in coherence errors when summarizing novels (arXiv 2023),
- Layout-infused language models can be worse than text-only language models at visual layout parsing (ACL Findings 2023),
- Language models can decontextualize snippets from Wikipedia but not scientific articles (EMNLP 2023).