Phases, Techniques and challenges of NLP
- [Evolution of NLP - Medium]
- Overview
Natural language processing (NLP) is a branch of artificial intelligence (AI) that allows computers to understand spoken words and text in a similar way to humans.
The five phases of NLP are: Lexical or morphological analysis, Syntax analysis, Semantic analysis, Discourse integration, Pragmatic analysis.
Some NLP techniques include:
- Semantic analysis: Analyzes the grammatical structure of sentences to determine the relationships between independent terms.
- Syntax analysis: Identifies the relationships between words and phrases within a sentence, and standardizes their structure.
- Sentiment analysis: Determines whether data is positive, negative, or neutral.
- Tokenization: Breaks characters, words, or subwords down into "tokens" that can be analyzed by a program.
Other NLP techniques include:
- Speech recognition
- Word modeling
- Vocabulary building
- Frequent word occurrence
[More to come ...]