an introduction to artificial intelligencemachine-cognition.com/ann/intro.pdf · title: an...
TRANSCRIPT
![Page 1: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/1.jpg)
An Introduction to Artificial Intelligence
By Dr Brad MorantzViral Immunology CenterGeorgia State University
Copyright 2010
![Page 2: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/2.jpg)
Star WarsTM
If I had anyREAL brains would I be doing this?
I hope that I don’tshort out any of his circuits.
![Page 3: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/3.jpg)
What is Intelligence?
Who knows what it isAbility to understand or reason (dictionary)Mental ability: learning, problem solving,
abstract thinking, & reasoning (encyclopaedia)Herb Simon Involves associations, pattern recognition,
inference, experience, & intuition 1948 Conference
![Page 4: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/4.jpg)
What does “Artificial” mean?
Random House College Dictionary:Produced by manMade in imitation or as a substituteSimulated
Examples Artificial Chocolate
May look and taste like chocolate, but it’s notHot dogs
Soy dogs look like hot dogs, kind of taste like them, are definitely healthier, but contain no meat.
![Page 5: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/5.jpg)
Then what is Artificial Intelligence?
Combining the termsSimulated ability to understand, reason, and
problem solve,or at least appear to
Ability of a computer to perform tasks (that human intelligence is capable of doing) such as reasoning and learning. (McGraw-Hill computer Handbook)
![Page 6: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/6.jpg)
What are we Trying to Accomplish?
Solve problems Improve performance Increase profitsForecastingBetter decisions
DSS – Decision Support SystemsModel biological to further understanding
![Page 7: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/7.jpg)
Example applications
MycinExpert system that helps doctors to diagnose
infectious blood diseasesTeresiusExpert system to help with investments
Microsoft OfficeTM
Uses AI to help correct mistakesTo do what it thinks is best
My work in forecasting CD ratesNeural network time series forecasting
![Page 8: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/8.jpg)
Current AI Methods
Expert Systems Case Based ReasoningNeural NetworksGenetic AlgorithmsFuzzy logicData MiningHybrid Synthetic Immune Systems
![Page 9: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/9.jpg)
Expert Systems
Just like having a subject expert The same as a Decision Tree Stored in a set of “If.. then..” rules Consists of
Rule base Inference engine/rule interpreter
Get rules from Human Expert Knowledge engineer converts knowledge into rules Example
If this is a corner, then must go into second gear
![Page 10: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/10.jpg)
Using an Expert System
StepsHire an expertHire a knowledge engineerCreate rule setApply problem
LimitationsCan only answer problems that it has already
seenContains biases of expertWhere is the intelligence?
![Page 11: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/11.jpg)
Case Based Reasoning
Very similar to our legal systemStore a large selection of casesLookup engineFind case like problem at handExampleThe last time the car would not go it was a
plugged fuel filter
![Page 12: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/12.jpg)
Applying CBR
Must have library of cases Inference engine is hard to create, looking for
similarities between problem and database of cases
Cannot solve anything that was not in the original database
Where is the intelligence?
![Page 13: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/13.jpg)
Neural Networks
What is a neural network?BiologicalComputer emulation (ANN)Massively parallel systemGeneral data driven function approximatorFunctions performedPattern recognitionClassificationForecasting/nonlinear regressionBrain emulation
![Page 14: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/14.jpg)
Feed Forward Neural Network
input
Output
![Page 15: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/15.jpg)
Model of Individual Neuron
Input is a large number of weighted outputs from nerves or other neuronsIt sums the weighted inputsIf the sum is greater than a threshold, then it fires
![Page 16: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/16.jpg)
Using Neural Networks
StepsGet training data setOptional clean the dataSet ANN architectureTrain the system
WeaknessesOperator designs architecture and sets trainingVery operator dependent
Where is the intelligence?
![Page 17: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/17.jpg)
Genetic Algorithms (GA)
John Holland and Schema Theorem, 1975 Imitates natural evolutionAlso called evolutionary computingModeled on natural selectionSurvival of the fittest
Exploited search in hyperspace (N space)Near optimal solution for complex problems
![Page 18: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/18.jpg)
How GA’s Work
Start with initial population of chromosomes Each one represents a possible solution Chromosome is a string of binary values
Mate with each other to produce new chromosomes, mutation included
Test all chromosomes Rate them (figure of merit) Kill off worst solutions Mate again and start all over Stop by 3 criteria
No more improvement Number of generations Achieved desired level of performance
![Page 19: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/19.jpg)
Using a Genetic Algorithm
Must make fitness functionDependent on criteria being searchedRates fitness of each chromosome
Give it initial populationWatch out for local maxima/minimaCan be used to find best or worstDepends on fitness function
Large overheadWhere is the intelligence?
![Page 20: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/20.jpg)
Fuzzy Logic
Lotfi Zadeh, 1968Originally developed for “specificity” to help
communicateTo convert lingual variables into computer inputsHot, cold, high, medium, low, too much, etc
Is there any intelligence here?Now Fuzzy Logic Type II Jerry MendelPrecisiated Natural Language
![Page 21: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/21.jpg)
Data Mining
Tons of data available today Look into the data
No preconceived ideas Look and see what you find Look for patterns
Today, people search data for specific things Heavily operator dependent Try statistics first, then SVM or PSVM. Also cluster analysis,
neural networks, other search methods SVM is Support Vector Machine PSVM is polynomial SVM Methods to group observations upon dimensions
Where is the intelligence?
![Page 22: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/22.jpg)
Synthetic Immune Systems
Mimics human autoimmune systemGood for computer securityDetects intrusions
Somewhat a reverse cluster analysisDetects if not in acceptable cluster
Uses statistics, clustering, pattern recognition, etc
Where is the intelligence?
![Page 23: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/23.jpg)
Hybrids
Combinations of the methodsMy workNeural networkLinked list databaseFuzzy logic on some inputsGenetic algorithms to set architecture & weights
Biological intelligence is truly a combination of methods
![Page 24: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/24.jpg)
Future
Systems that set themselves up learn from successes and mistakes learn from the environmentBehave like biological intelligence
Autonomous learningDriving factors:Security
Anti terrorism “Big Brother”
BusinessEvery facet including marketing
![Page 25: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/25.jpg)
Some Applications
Computer SecurityWho to let inAcceptable activityVirus detection
DetectionSniper in treeSubmarine in under water
ClassificationCredit approvalCredit card transaction approval
![Page 26: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/26.jpg)
More Applications
Pattern recognition Guidance system Iris Scans Retina scans Finger prints Criminal activity Purchasing patterns Voice recognition Character recognition
Forecasting Stock prices or other financial data Tracker for radar/sonar Non-linear regression
![Page 27: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/27.jpg)
Even More Applications
OptimizationTraveling salesman problemComplex scheduling problemSetting weights and architecture of ANN
Bio-medical Seizure predictionModel brainCondition recognitionDiagnosis support
![Page 28: An Introduction to Artificial Intelligencemachine-cognition.com/ann/intro.pdf · Title: An Introduction to Artificial Intelligence Created Date: 5/9/2011 1:43:16 AM](https://reader033.vdocuments.us/reader033/viewer/2022052101/603bd45d0b22775e2812f845/html5/thumbnails/28.jpg)
ReferencesThe IEEE www.ieee.orgwww.machine-cogntion.comAmerican Association for Artificial Intelligence www.aaai.orgIEEE Intelligent Systems JournalArtificial Intelligence: A Modern Approach, Russell & NorvigHuman Problem Solving, Newell & SimonIEEE Computational Intelligence Society:www.ieee-cis.org