the particle swarm optimization algorithm nebojša trpković [email protected] 10 th dec 2010
TRANSCRIPT
![Page 2: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/2.jpg)
Nebojša Trpković [email protected] Slide 2 of 18
Problem Definition
optimization of continuous nonlinear functions
↓
finding the best solution in problem space
![Page 4: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/4.jpg)
Nebojša Trpković [email protected] Slide 4 of 18
Importance
• function optimization
• artificial neural network training
• fuzzy system control
![Page 5: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/5.jpg)
Nebojša Trpković [email protected] Slide 5 of 18
Existing Solutions
• Ant Colony (ACO)– discrete
• Genetic Algorithms (GA)– slow convergence
![Page 6: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/6.jpg)
Nebojša Trpković [email protected] Slide 6 of 18
Particle Swarm Optimization
Very simple classification:
• a computational method • that optimizes a problem • by iteratively trying to improve a candidate solution • with regard to a given measure of quality
![Page 7: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/7.jpg)
Nebojša Trpković [email protected] Slide 7 of 18
Particle Swarm Optimization
Facts:
• developed by Russell C. Eberhart and James Kennedy in 1995
• inspired by social behavior of bird flocking or fish schooling
• similar to evolutionary techniques such as Genetic Algorithms (GA)
![Page 8: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/8.jpg)
Nebojša Trpković [email protected] Slide 8 of 18
Particle Swarm Optimization
Benefits:
• faster convergence• less parameters to tune
↓• easier searching in very large problem spaces
![Page 9: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/9.jpg)
Nebojša Trpković [email protected] Slide 9 of 18
Particle Swarm Optimization
Basic principle:
let particle swarm move towards the best position in search space, remembering each particle’s best known position and global (swarm’s) best known position
![Page 10: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/10.jpg)
Nebojša Trpković [email protected] Slide 10 of 18
Velocity Change
xi – specific particle
pi – particle’s (personal) best known position
g – swarm’s (global) best known positionvi – particle’s velocity
vi ← ωvi + φprp(pi - xi) + φgrg(g - xi) inertia cognitive social
![Page 11: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/11.jpg)
Nebojša Trpković [email protected] Slide 11 of 18
Position Change
xi – specific particle
vi – particle’s velocity
xi ← xi + vi
![Page 12: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/12.jpg)
Nebojša Trpković [email protected] Slide 12 of 18
AlgorithmFor each particle Initialize particleEND
Do
For each particle Calculate fitness value If the fitness value is better than the best personal fitness value in history, set current value
as a new best personal fitness value End
Choose the particle with the best fitness value of all the particles, and if that fitness value is better then current global best, set as a global best fitness value
For each particle Calculate particle velocity according velocity change equation Update particle position according position change equation End
While maximum iterations or minimum error criteria is not attained
![Page 14: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/14.jpg)
Nebojša Trpković [email protected] Slide 14 of 18
Parameters selection
Different ways to choose parameters:
• proper balance between exploration and exploitation (avoiding premature convergence to a local optimum yet still ensuring a good rate of convergence to the optimum)
• putting all attention on exploitation (making possible searches in a vast problem spaces)
• automatization by meta-optimization
![Page 15: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/15.jpg)
Nebojša Trpković [email protected] Slide 15 of 18
Avoiding Local Optimums
• adding randomization factor to velocity calculation
• adding random momentum in a specific iterations
![Page 17: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/17.jpg)
Nebojša Trpković [email protected] Slide 17 of 18
Conclusion
“This algorithm belongs ideologically to that philosophical school
that allows wisdom to emerge rather than trying to impose it,
that emulates nature rather than trying to control it,
and that seeks to make things simpler rather than more complex.”
James Kennedy, Russell Eberhart
![Page 18: The Particle Swarm Optimization Algorithm Nebojša Trpković trx.lists@gmail.com 10 th Dec 2010](https://reader036.vdocuments.us/reader036/viewer/2022081519/56649eda5503460f94be8ba5/html5/thumbnails/18.jpg)
Nebojša Trpković [email protected] Slide 18 of 18
References• Wikipedia
http://www.wikipedia.org/• Swarm Intelligence
http://www.swarmintelligence.org/• Application of a particle swarm optimization algorithm for
determining optimum well location and type, Jerome Onwunalu and Louis J. Durlofsky, 2009
• Particle Swarm Optimization, James Kennedy and Russell Eberhart, 1995http://www.engr.iupui.edu/~shi/Coference/psopap4.html
• Robot Swarm driven by Particle Swarm Optimization algorithm, thinkfluidhttp://www.youtube.com/watch?v=RLIA1EKfSys