![Page 1: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/1.jpg)
Introduction to Linguistics 165: Computational Linguistics
Roger Levy 5 January 2015
![Page 2: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/2.jpg)
• Formal tools for computing with natural language structure: lexicon, phonology, morphology, syntax • Automatically classifying documents (Spam detection) • Automated speech recognition by computers • Automated spelling and grammar correction • Information retrieval (web search!) and extraction •Machine translation •Question answering (Ask.com) • Automated document summarization
What is computational linguistics?
2
![Page 3: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/3.jpg)
Why study computational linguistics?• Financial payoff!
...if someone told me I had to make a million bucks in one year...I'd grab a copy of [a computational linguistics textbook] and start a web text-processing company.
-- Peter Norvig, director of research, Google
3
![Page 4: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/4.jpg)
Why study computational linguistics?• Scientific interest!
I have emphasized in my writings on this subject that the challenge to psychological theory made by linguists to provide an adequate theory of language learning may well be regarded as the most significant intellectual challenge to theoretical psychology in this century. At the present time numerous difficult problems of providing a completely adequate scientific theory of language learning and language performance are enough to make even the most optimistic theorist uneasy. In very developed areas of science or mathematics, it is familiar to find the statement made that certain kinds of problems are simply far beyond the resources currently available but that certain more restricted problems are amenable to serious attack and likely solution.
-- Patrick Suppes, Lucie Stern Professor of Philosophy, Emeritus
4
![Page 5: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/5.jpg)
Why study computational linguistics?• Fun! !
[At least, I hope to convince you of that over the next eleven weeks!]
5
![Page 6: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/6.jpg)
NLP is everywhere in technology
6
![Page 7: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/7.jpg)
In web search, there’s NLP under the hood
7
![Page 8: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/8.jpg)
In web search, there’s NLP under the hood
7
![Page 9: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/9.jpg)
In web search, there’s NLP under the hood
7
![Page 10: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/10.jpg)
Predictive text has hit mobile
8
![Page 11: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/11.jpg)
Predictive text has hit mobile
8
![Page 12: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/12.jpg)
Computers can answer NL questions
9
![Page 13: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/13.jpg)
Machine Translation is becoming reality• (https://www.youtube.com/watch?v=5W5QgcQoKLM —
start about 6:30 into the video)
10
![Page 14: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/14.jpg)
Machine Translation is becoming reality• (https://www.youtube.com/watch?v=5W5QgcQoKLM —
start about 6:30 into the video)
10
![Page 15: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/15.jpg)
NLP lets us study the history of culture too
11
![Page 16: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/16.jpg)
…and the history of language itself
12
![Page 17: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/17.jpg)
Examples you can try at home•Machine translation. It works pretty well sometimes!
13
![Page 18: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/18.jpg)
Examples you can try at home• ...and sometimes it doesn’t work nearly as well.
14
![Page 19: Introduction to Linguistics 165: Computational Linguisticsidiom.ucsd.edu/.../lign165/lectures/lecture1/lecture_1_intro.pdf · Introduction to Linguistics ... with using computers](https://reader034.vdocuments.us/reader034/viewer/2022051509/5afbd6587f8b9a444f8b5359/html5/thumbnails/19.jpg)
What we’ll do today, and in the course• This is a hands-on course designed to get you familiar
with using computers to process human language • You’ll learn how to do this with some computational
tools, especially the programming language Python •Class time will be a mix of lectures (MW) and practicum
sessions (F) • You’ll have both pen-and-paper and simple computer-
programming assignments •We’ll set up the key computational tools you’ll need are
on instructional servers • Though you’ll definitely do well to install Python and
NLTK on your own computer or laptop!
15