Large Language Models: A Survey
Shervin Minaee, Tomáš Mikolov, Nikzad, Narjes et al.
2024 · arXiv (Cornell University) · 231 citations
Large Language Models (LLMs) have drawn a lot of attention due to their strong performance on a wide range of natural language tasks, since the release of ChatGPT in November 2022. LLMs' ability of general-purpose language understanding and generation is acquired by training billions of model's parameters on massive amounts of text data, as predicted by scaling laws \cite{kaplan2020scaling,hoffmann2022training}. The research area of LLMs, while very recent, is evolving rapidly in many different ways. In this paper, we review some of the most prominent LLMs, including three popular LLM familie…
Explore this paper's citation graph on Constellation.