teaching the basics of nlp and ml in an introductory ...apoorv/homepage/publications... · teaching...
TRANSCRIPT
![Page 1: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/1.jpg)
Teaching the Basics of NLP and ML in an Introductory Course to Information Science
Apoorv AgarwalColumbia University
Sunday, September 8, 13
![Page 2: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/2.jpg)
COMS1001
Sunday, September 8, 13
![Page 3: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/3.jpg)
COMS1001
• Introductory course on information science to undergraduates at Columbia University
Sunday, September 8, 13
![Page 4: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/4.jpg)
COMS1001
• Introductory course on information science to undergraduates at Columbia University
• Mostly taken by freshmen and sophomores
Sunday, September 8, 13
![Page 5: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/5.jpg)
COMS1001
• Introductory course on information science to undergraduates at Columbia University
• Mostly taken by freshmen and sophomores
• Assumes no prior programming or math background
Sunday, September 8, 13
![Page 6: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/6.jpg)
COMS1001
• Introductory course on information science to undergraduates at Columbia University
• Mostly taken by freshmen and sophomores
• Assumes no prior programming or math background
• 10% : what’s a programming language?
Sunday, September 8, 13
![Page 7: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/7.jpg)
Student demographics
Sunday, September 8, 13
![Page 8: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/8.jpg)
Student demographics
Sunday, September 8, 13
![Page 9: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/9.jpg)
Student demographics
Math and Engineering majors
Sunday, September 8, 13
![Page 10: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/10.jpg)
Student demographics
Math and Engineering majors
Challenge 1: Cannot use Math terminology: vector space, dot product, high-dimensional space etc.
Sunday, September 8, 13
![Page 11: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/11.jpg)
Traditionally taught topics
Sunday, September 8, 13
![Page 12: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/12.jpg)
Traditionally taught topics
• About thirty 75 min lectures
Sunday, September 8, 13
![Page 13: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/13.jpg)
Traditionally taught topics
• About thirty 75 min lectures
• First half: Operating systems, WWW and the Internet, Binary and Machine Language, Spreadsheets, Database systems
Sunday, September 8, 13
![Page 14: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/14.jpg)
Traditionally taught topics
• About thirty 75 min lectures
• First half: Operating systems, WWW and the Internet, Binary and Machine Language, Spreadsheets, Database systems
• Second half: Algorithms, Programming in Python
Sunday, September 8, 13
![Page 15: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/15.jpg)
Traditionally taught topics
• About thirty 75 min lectures
• First half: Operating systems, WWW and the Internet, Binary and Machine Language, Spreadsheets, Database systems
• Second half: Algorithms, Programming in Python
Challenge 2: Introduce NLP/ML in one lecture
Sunday, September 8, 13
![Page 16: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/16.jpg)
Overall Strategy
Sunday, September 8, 13
![Page 17: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/17.jpg)
Overall Strategy
• Keep definitions simple
Sunday, September 8, 13
![Page 18: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/18.jpg)
Overall Strategy
• Keep definitions simple
• Use analogies and concrete examples (also observed by Reva Freedman 2005)
Sunday, September 8, 13
![Page 19: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/19.jpg)
Overall Strategy
• Keep definitions simple
• Use analogies and concrete examples (also observed by Reva Freedman 2005)
• Take baby steps -- incremental learning
Sunday, September 8, 13
![Page 20: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/20.jpg)
Overall Strategy
• Keep definitions simple
• Use analogies and concrete examples (also observed by Reva Freedman 2005)
• Take baby steps -- incremental learning
• Introduce the core concepts in one lecture and build on them using homework and exam problems
Sunday, September 8, 13
![Page 21: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/21.jpg)
Strategy
Sunday, September 8, 13
![Page 22: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/22.jpg)
Strategy
Sentiment analysis of tweets
Sunday, September 8, 13
![Page 23: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/23.jpg)
Strategy
Sentiment analysis of tweets
Sentiment analysis of movie reviews
Sunday, September 8, 13
![Page 24: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/24.jpg)
Strategy
Sentiment analysis of tweets
Sentiment analysis of movie reviews
Email classification into Imp/Not-Imp
Sunday, September 8, 13
![Page 25: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/25.jpg)
Strategy
Sentiment analysis of tweets
Sentiment analysis of movie reviews
Email classification into Imp/Not-Imp
Gear towards text processing
Sunday, September 8, 13
![Page 26: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/26.jpg)
Strategy
Sentiment analysis of tweets
Sentiment analysis of movie reviews
Email classification into Imp/Not-Imp
Gear towards text processing
Implement end-to-end SA pipeline
Sunday, September 8, 13
![Page 27: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/27.jpg)
Overview
• Lecture organization
• Questions asked in class
• Performance on the mid-term examination
• Final projects
• Conclusion
Sunday, September 8, 13
![Page 28: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/28.jpg)
Lecture Organization
Sunday, September 8, 13
![Page 29: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/29.jpg)
Lecture Organization
• General discussion on how to define intelligence
Sunday, September 8, 13
![Page 30: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/30.jpg)
Lecture Organization
• General discussion on how to define intelligence
• Introduce a concrete application: sentiment analysis of Twitter data
Sunday, September 8, 13
![Page 31: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/31.jpg)
Lecture Organization
• General discussion on how to define intelligence
• Introduce a concrete application: sentiment analysis of Twitter data
• Demonstrate annotation process
Sunday, September 8, 13
![Page 32: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/32.jpg)
Lecture Organization
• General discussion on how to define intelligence
• Introduce a concrete application: sentiment analysis of Twitter data
• Demonstrate annotation process
• Demonstrate feature extraction
Sunday, September 8, 13
![Page 33: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/33.jpg)
Lecture Organization
• General discussion on how to define intelligence
• Introduce a concrete application: sentiment analysis of Twitter data
• Demonstrate annotation process
• Demonstrate feature extraction
• Demonstrate a basic classification process
Sunday, September 8, 13
![Page 34: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/34.jpg)
Points we drive home
Sunday, September 8, 13
![Page 35: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/35.jpg)
Points we drive home
1. The machine automatically learns the connotation of words by looking at how often certain words appear in positive and negative tweets.
Sunday, September 8, 13
![Page 36: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/36.jpg)
Points we drive home
1. The machine automatically learns the connotation of words by looking at how often certain words appear in positive and negative tweets.
2. The machine also learns more complex patterns that have to do with the conjunction and disjunction of features.
Sunday, September 8, 13
![Page 37: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/37.jpg)
Points we drive home
1. The machine automatically learns the connotation of words by looking at how often certain words appear in positive and negative tweets.
2. The machine also learns more complex patterns that have to do with the conjunction and disjunction of features.
3. The quality and amount of training data is important – for if the training data fails to encode a substantial number of patterns important for classification, the machine is not going to learn well.
Sunday, September 8, 13
![Page 38: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/38.jpg)
Questions asked in class by students
Sunday, September 8, 13
![Page 39: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/39.jpg)
Questions asked in class by students
1. Could we create and use a dictionary that lists the prior polarity of commonly used words?
Sunday, September 8, 13
![Page 40: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/40.jpg)
Questions asked in class by students
1. Could we create and use a dictionary that lists the prior polarity of commonly used words?
2. If the prediction score for the tweet is high, does that mean the machine is more confident about the prediction?
Sunday, September 8, 13
![Page 41: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/41.jpg)
Questions asked in class by students
1. Could we create and use a dictionary that lists the prior polarity of commonly used words?
2. If the prediction score for the tweet is high, does that mean the machine is more confident about the prediction?
3. In the unigram approach, the sequence of words does not matter. But clearly, if “not” does not negate the words containing opinion, then won’t the machine learn a wrong pattern?
Sunday, September 8, 13
![Page 42: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/42.jpg)
Questions asked in class by students
1. Could we create and use a dictionary that lists the prior polarity of commonly used words?
2. If the prediction score for the tweet is high, does that mean the machine is more confident about the prediction?
3. In the unigram approach, the sequence of words does not matter. But clearly, if “not” does not negate the words containing opinion, then won’t the machine learn a wrong pattern?
4. If we have too many negative tweets in our training data (as compared to the positive tweets), then would the machine not be predisposed to predict the polarity of an unseen tweet as negative?
Sunday, September 8, 13
![Page 43: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/43.jpg)
Mid-term: Email classification• 53 students• Required to do only 2 out of the following 4 problems
Sunday, September 8, 13
![Page 44: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/44.jpg)
Mid-term: Email classification
Problem (25 points) Average Std-dev Median # students
attempted
NLP/ML 20.54 4.46 22 51
Logic Gates 16.94 6.48 20 36
Database design 13.63 6.48 14 42
Machine Instructions 12.8 6.81 14.5 30
• 53 students• Required to do only 2 out of the following 4 problems
Sunday, September 8, 13
![Page 45: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/45.jpg)
Mid-term: Email classification
Problem (25 points) Average Std-dev Median # students
attempted
NLP/ML 20.54 4.46 22 51
Logic Gates 16.94 6.48 20 36
Database design 13.63 6.48 14 42
Machine Instructions 12.8 6.81 14.5 30
• 53 students• Required to do only 2 out of the following 4 problems
Sunday, September 8, 13
![Page 46: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/46.jpg)
Mid-term: Email classification
Problem (25 points) Average Std-dev Median # students
attempted
NLP/ML 20.54 4.46 22 51
Logic Gates 16.94 6.48 20 36
Database design 13.63 6.48 14 42
Machine Instructions 12.8 6.81 14.5 30
• 53 students• Required to do only 2 out of the following 4 problems
Sunday, September 8, 13
![Page 47: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/47.jpg)
Mid-term: Email classification
Problem (25 points) Average Std-dev Median # students
attempted
NLP/ML 20.54 4.46 22 51
Logic Gates 16.94 6.48 20 36
Database design 13.63 6.48 14 42
Machine Instructions 12.8 6.81 14.5 30
• 53 students• Required to do only 2 out of the following 4 problems
Sunday, September 8, 13
![Page 48: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/48.jpg)
Mid-term: Email classification
Problem (25 points) Average Std-dev Median # students
attempted
NLP/ML 20.54 4.46 22 51
Logic Gates 16.94 6.48 20 36
Database design 13.63 6.48 14 42
Machine Instructions 12.8 6.81 14.5 30
• 53 students• Required to do only 2 out of the following 4 problems
Sunday, September 8, 13
![Page 49: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/49.jpg)
Student projects
Sunday, September 8, 13
![Page 50: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/50.jpg)
Student projects
• Formulate your own task
Sunday, September 8, 13
![Page 51: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/51.jpg)
Student projects
• Formulate your own task
• Collect and annotate data
Sunday, September 8, 13
![Page 52: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/52.jpg)
Student projects
• Formulate your own task
• Collect and annotate data
• Define the feature space
Sunday, September 8, 13
![Page 53: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/53.jpg)
Student projects
• Formulate your own task
• Collect and annotate data
• Define the feature space
• Train and test
Sunday, September 8, 13
![Page 54: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/54.jpg)
Student projects
• Formulate your own task
• Collect and annotate data
• Define the feature space
• Train and test
Incentive was low
Sunday, September 8, 13
![Page 55: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/55.jpg)
Student projects
• Formulate your own task
• Collect and annotate data
• Define the feature space
• Train and test
Incentive was low
But still, 15/53 students decided to pursue the project and 11 actually managed to finish it
Sunday, September 8, 13
![Page 56: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/56.jpg)
The Bechdel Test (bechdeltest.com)
Sunday, September 8, 13
![Page 57: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/57.jpg)
The Bechdel Test (bechdeltest.com)
• A test for movies (Allison Bechdel, 1985)
Sunday, September 8, 13
![Page 58: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/58.jpg)
The Bechdel Test (bechdeltest.com)
• A test for movies (Allison Bechdel, 1985)
• A movie passes this test if all 3 conditions are met:
Sunday, September 8, 13
![Page 59: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/59.jpg)
The Bechdel Test (bechdeltest.com)
• A test for movies (Allison Bechdel, 1985)
• A movie passes this test if all 3 conditions are met:
• There are at least 2 named female characters
Sunday, September 8, 13
![Page 60: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/60.jpg)
The Bechdel Test (bechdeltest.com)
• A test for movies (Allison Bechdel, 1985)
• A movie passes this test if all 3 conditions are met:
• There are at least 2 named female characters
• They talk to each other
Sunday, September 8, 13
![Page 61: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/61.jpg)
The Bechdel Test (bechdeltest.com)
• A test for movies (Allison Bechdel, 1985)
• A movie passes this test if all 3 conditions are met:
• There are at least 2 named female characters
• They talk to each other
• They talk about something other than a man
Sunday, September 8, 13
![Page 62: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/62.jpg)
The Bechdel Test (bechdeltest.com)
• A test for movies (Allison Bechdel, 1985)
• A movie passes this test if all 3 conditions are met:
• There are at least 2 named female characters
• They talk to each other
• They talk about something other than a man
• Pass only 1 test: The Great Gatsby, Star trek into Darkness, Now you see me, The Internship
Sunday, September 8, 13
![Page 63: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/63.jpg)
Conclusion
Sunday, September 8, 13
![Page 64: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/64.jpg)
Conclusion
• We presented a strategy using which basic NLP/ML concepts may be taught in an introductory course, in one lecture (supported by HW and exam problems)
Sunday, September 8, 13
![Page 65: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/65.jpg)
Conclusion
• We presented a strategy using which basic NLP/ML concepts may be taught in an introductory course, in one lecture (supported by HW and exam problems)
• The basics can be taught without using math terminology
Sunday, September 8, 13
![Page 66: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/66.jpg)
Conclusion
• We presented a strategy using which basic NLP/ML concepts may be taught in an introductory course, in one lecture (supported by HW and exam problems)
• The basics can be taught without using math terminology
• Important outcome -- students find Watson playing Jeopardy! and Google’s self-driving car less “magical”
Sunday, September 8, 13
![Page 67: Teaching the Basics of NLP and ML in an Introductory ...apoorv/Homepage/Publications... · Teaching the Basics of NLP and ML in an Introductory Course to Information Science Apoorv](https://reader035.vdocuments.us/reader035/viewer/2022081401/5f07ec707e708231d41f704f/html5/thumbnails/67.jpg)
Thanks!
Questions?
Sunday, September 8, 13