This document provides information on the course "A77-- Natural Language Processing" including:
- It is a 3 credit course meeting for 2 hours of lecture and 2 hours of lab per week over one semester. Students will be assessed through continuous internal evaluation (30%) and semester end examination (70%).
- The course introduces the basics of natural language processing and teaches how to extract information from unstructured text using machine learning techniques like sentiment analysis.
- Upon completing the course, students will able to preprocess text, parse documents, model language, and apply NLP to applications such as question answering and information retrieval.
This document provides information on the course "A77-- Natural Language Processing" including:
- It is a 3 credit course meeting for 2 hours of lecture and 2 hours of lab per week over one semester. Students will be assessed through continuous internal evaluation (30%) and semester end examination (70%).
- The course introduces the basics of natural language processing and teaches how to extract information from unstructured text using machine learning techniques like sentiment analysis.
- Upon completing the course, students will able to preprocess text, parse documents, model language, and apply NLP to applications such as question answering and information retrieval.
This document provides information on the course "A77-- Natural Language Processing" including:
- It is a 3 credit course meeting for 2 hours of lecture and 2 hours of lab per week over one semester. Students will be assessed through continuous internal evaluation (30%) and semester end examination (70%).
- The course introduces the basics of natural language processing and teaches how to extract information from unstructured text using machine learning techniques like sentiment analysis.
- Upon completing the course, students will able to preprocess text, parse documents, model language, and apply NLP to applications such as question answering and information retrieval.
This document provides information on the course "A77-- Natural Language Processing" including:
- It is a 3 credit course meeting for 2 hours of lecture and 2 hours of lab per week over one semester. Students will be assessed through continuous internal evaluation (30%) and semester end examination (70%).
- The course introduces the basics of natural language processing and teaches how to extract information from unstructured text using machine learning techniques like sentiment analysis.
- Upon completing the course, students will able to preprocess text, parse documents, model language, and apply NLP to applications such as question answering and information retrieval.
Hours Per Hours Per Credits Assessment Week Semester Marks L T P L T P C CIE SEE Total 2 0 2 28 0 28 3 30 70 100
1. Course Description Course Overview Natural Language Processing is the art of extracting information from unstructured text. Learn basics of Natural Language Processing, Regular Expressions & text sentiment analysis using machine learning in this course. Natural Language Processing (NLP) is basically how we can teach machines to understand human languages and extract meaning from text. The course covers the phases of NLP processing and uses libraries provided by NLP to analyze the given text document. Course Pre/co-requisites A7503: Python Programming A7704: Foundations of Machine Learning
2. Course Outcomes (COs)
After the completion of the course, the student will be able to: A77--.1 Identify the structure of words and documents for text preprocessing. A77__.2 Choose an approach to parse the given text document. A77--.3 Make use of semantic parsing to capture real meaning of text. A77--.4 Select a language model to predict the probability of a sequence of words. A77--.5 Examine the various applications of NLP. 3. Course Syllabus
Introduction: What is Natural Language Processing (NLP), Origins of NLP, The Chal- lenges of NLP, Phases of NLP, Language and Grammar. Finding the Structure of Words and Documents: Words and Their Components, Issues and Challenges, Morphological Models. Finding the Structure of Documents: Introduction, Sentence Boundary Detection, Topic Bound- ary Detection, Methods, Complexity of the Approaches, Performances of the Approaches, Features, Processing Stages. Syntax: Parsing Natural Language, A Data-Driven Approach to Syntax, Stop words, Correcting Words, Stemming, Lemmatization, Parts of Speech (POS) Tagging, Representation of Syntactic Structure, Parsing Algorithms, Models for Ambiguity Resolution in Parsing. Semantic Parsing: Introduction, Semantic Interpretation: Structural Ambiguity, Entity and Event Resolution, System Paradigms, Word Sense, Predicate-Argument Structure, Meaning Representation. Language modelling: Introduction, n-Gram Models, Language Model Evaluation, Pa- rameter Estimation, Types of Language Models: Class-Based Language Models, MaxEnt Language Models, Neural Network Language Models Language- Specific Modeling Problems, Multilingual and Crosslingual Language Modeling.
108 Applications: Question Answering: History, Architectures, Question Analysis, Search and Candidate Extraction, Automatic Summarization: Approaches to Summarization, Spoken Dialog Systems: Speech Recognition and Understanding, Speech Generation, Dialog Manager, Voice User Interface, Information Retrieval: Document Preprocessing, Monolingual Information Retrieval
Practice
1. a. Write a program to Tokenize Text to word using NLTK.
b. Write a program to Tokenize Text to Sentence using NLTK. 2. a. Write a program to remove numbers, punctuations, and whitespaces in a file. b. Write a program to Count Word Frequency in a file. 3. Write a program to Tokenize and tag the following sentence using Morphological Analysis in NLP. 4. a. Write a program to get Synonyms from WordNet. b. Write a program to get Antonyms from WordNet. 5. a. Write a program to show the difference in the results of Stemming and Lemmatization. b. Write a program to Lemmatizing Words Using WordNet. 6. a. Write a program to print all stop words in NLP. b. Write a program to remove all stop words from a given text. 7. Write a Python program to apply Collocation extraction word combinations in the text. Collocation examples are “break the rules,” “free time,” “draw a conclusion,” “keeps in mind,” “get ready,” and so on. 8. Write a Python program to extract Relationship that allows obtaining structured in- formation from unstructured sources such as raw text. Strictly stated, it is identifying relations (e.g., acquisition, spouse, employment) among named entities (e.g., people, organizations, locations). For example,from the sentence “Mark and Emily married yesterday,” we can extract the information that Mark is Emily’s husband. 9. Write a program to print POS and parse tree of a given Text. 10. Write a program to print bigram and Trigram of a given Text. 11. Implement a case study of NLP application.
Laboratory Equipment/Software/Tools Required
a. A Computer System with Ubuntu Operating System. b. Python 3.x or above version c. Jupyter Notebook or Pycharm IDE Books and Materials
Text Books:
1. Daniel M. Bikel Imed Zitouni., Multilingual Natural Language Processing Applications: From Theory to Practice, IBM Press, 2013. 2. Tanveer Siddiqui, U.S. Tiwary., Natural Language Processing and Information Re- trieval, Oxford University, 2008. Reference Books: 1. Daniel Jurafsky and James H Martin., Speech and Language Processing: An in- troduction to Natural Language Processing, Computational Linguistics and Speech Recognition,2nd Edition, Prentice Hall, 2008. 2. James Allen., Natural Language Understanding,2 nd Edition, Cummings publishing company,1995. 2
