Evolution of Natural Language Processing
Abstract
Written language has not been immune to cultural and technological changes. For example, the invention of the printing press in the 15th century, or the development of personal computers and smartphones in recent decades, were milestones that dramatically marked its evolution. In parallel with the development of language, the evolution of computing and the emergence of intelligent algorithms capable of making decisions have made impressive advances in recent years, forming a new area of study known as artificial intelligence (AI), considered by many as the next great revolution. The integration of AI techniques to interpret, manipulate and understand human language results in the branch of natural language processing (NLP), which, taking into account the latest advances in language generation models, can become the next great milestone in written language. The first NLP algorithms were rule-based, but later supervised classification schemes based on models such as logistic regression, support vector machines, hidden Markov models, or conditional random trees began to be used. The problem with traditional classification models is that they are oriented to evaluate each word, or the relationships between each word and the previous word, but they do not capture the context of the words in a complete sentence.
References
T. Mikolov, I. Sutskever, K. Chen, G. Corrado, and J. Dean, “Distributed Representations of Words and Phrases and their Compositionality,” arXiv, Oct. 2013, Accessed: Mar. 26, 2023. https://doi.org/10.48550/arXiv.1310.4546
A. Vaswani et al., “Attention Is All You Need,” Neural Information Processing Systems, Long Beach, CA, USA, Jun. 2017, Accessed: Mar. 26, 2023. https://doi.org/10.48550/arXiv.1706.03762
OpenAI, “GPT-4 Technical Report,” Mar. 2023. http://arxiv.org/abs/2303.08774
H. Touvron et al., “LLaMA: Open and Efficient Foundation Language Models,” arXiv, Feb. 2023. http://arxiv.org/abs/2302.13971
Downloads
Copyright (c) 2023 TecnoLógicas
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.