advance in fireworks algorithm and its applications ying tan ( 谭营 ) peking university contact...
TRANSCRIPT
![Page 1: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/1.jpg)
Advance in Fireworks Algorithm and its Applications
Ying Tan ( 谭营 )Peking University
www.cil.pku.edu.cn
This PPT is available at www.cil.pku.edu.cn/research/fa.
![Page 2: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/2.jpg)
2
04/18/23
Outlines
1. Brief Introduction to Swarm Intelligence2. basic Fireworks Algorithm (FA) 3. FA Variant4. Latest Applications of FA
FA for NMF FA for Document Clustering
5. Concluding Remarks
![Page 3: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/3.jpg)
3
04/18/23
1.Brief Introduction to Swarm Intelligence
1.1 Swarm Intelligence (SI) refers to Simple individuals or information
processing units Interaction between individuals or with
environment
from nature to artificial systems
![Page 4: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/4.jpg)
4
04/18/23
1.Brief Introduction to SI
1.2 Some Famous SI Algorithms: Particle Swarm Optimization (PSO) Ant Colony Optimization (ACO) Artificial Immune System (AIS) Bee Colony Optimization (BCO) Bacterial Foraging Optimization (BFO) Fish School Search (FSS) Seeker Optimization Algorithm (SOA)To name a few
![Page 5: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/5.jpg)
5
04/18/23
1. Motivation
Biological population Social phenomenon Other laws in a swarm in nature
![Page 6: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/6.jpg)
6
04/18/23
1.2.1 Particle Swarm Optimization (PSO)
Inspired by the search food of flocks
![Page 7: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/7.jpg)
7
04/18/23
1.2.1 Particle Swarm Optimization
A birds flock is searching for a food, and every bird does not know where the food is. But, they know presently the distance of each bird to the food
This seeking behavior was associated with that of an optimization
how to make a strategy that the bird can get to the
food fastest?
![Page 8: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/8.jpg)
8
04/18/23
1.2.1 PSO principle
solutions
How to choose ?
![Page 9: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/9.jpg)
9
04/18/23
1.2.1 Visual demonstration of PSO
![Page 10: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/10.jpg)
10
04/18/23
1.2.2 Ant Colony Optimization (ACO)
Ant system searches Food from Nest
ANT.EXE (AVI1)
![Page 11: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/11.jpg)
11
04/18/23
Double Bridge Experiment
Auto-catalytic (positive feedback) process
![Page 12: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/12.jpg)
12
04/18/23
Welcome to ICSI 2012 Shenzhen, CN.
www.ic-si.org
![Page 13: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/13.jpg)
13
04/18/23
1.3 Introduction to Fireworks Algorithm
When a firework is set Off, a shower of sparks will fill the local space around the firework.
The explosion can be viewed as a search in the local Space around a firework.
![Page 14: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/14.jpg)
14
04/18/23
![Page 15: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/15.jpg)
15
04/18/2315
from Nature to Mathematical Modeling
Definition of firework
Good firework: firework can generate a bigpopulation of sparks within a small range.Bad firework: firework that generate a small Population of sparks within a big range.
The basic FA algorithm is on the basis of simulating the process of the firework explosion illuminating the night sky.
![Page 16: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/16.jpg)
16
04/18/23
2. Basic Firework Algorithm (FA)
2.1 Problem description2.2 Flowchart of FA 2.3 Design of basic FA
Selection operators Number of son sparks
2.4 Experimental results
![Page 17: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/17.jpg)
17
04/18/23
2.1 Problem description
![Page 18: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/18.jpg)
18
04/18/23
2.2 FA’s Flowchart
Repeat
N
Y
![Page 19: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/19.jpg)
19
04/18/23
2.3 Design of basic Firework Algorithm
![Page 20: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/20.jpg)
20
04/18/23
2.3 Design of basic Firework Algorithm
![Page 21: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/21.jpg)
21
04/18/23
2.3 Design of basic Firework Algorithm
BAD
BIG RANGELITTLE SPARKS
GOOD
SMALL RANGEMORE SPARKS
![Page 22: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/22.jpg)
22
04/18/23
2.3 Design of basic Firework Algorithm
Generating Sparks. In explosion, sparks may undergo the effects of explosion from random z directions (dimensions).
![Page 23: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/23.jpg)
23
04/18/23
2.3 Design of basic Firework Algorithm
Crowd
Sparse
KEEP DIVERSITY!
![Page 24: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/24.jpg)
24
04/18/23
2.3 Design of basic Firework Algorithm
To keep the diversity of sparks, we design another way of generating sparks----Gaussian explosion.
![Page 25: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/25.jpg)
25
04/18/23
2.4 Experiments results of basic FA
![Page 26: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/26.jpg)
26
04/18/23
2.4 Experiments results of basic FA
![Page 27: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/27.jpg)
27
04/18/23
2.4 Experiments results of basic FA
![Page 28: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/28.jpg)
28
04/18/23
2.4 Experiments results of basic FA
![Page 29: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/29.jpg)
29
04/18/23
Explosion Search Demonstrations of FA
Sphere (AVI2)
Benchmark function f18 (AVI3)
![Page 30: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/30.jpg)
30
04/18/23
3. FA variants 3.1 Motivation of FA variants3.2 Definition for FA variants 3.3 FA with fixed minimal explosion amplitude3.4 FA with dynamic minimal explosion amplitude
![Page 31: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/31.jpg)
31
04/18/23
3.1 Motivation of FA variants
By comprehensively analyzing the techniques of fireworks explosion, our findings suggest that some of the generated sparks can hardly make any contribution to the optimization if they do not come to a local space while take a lot of ”resource”.
LOW DIVERSITY!!
Too Many Sparks in such a small range
![Page 32: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/32.jpg)
32
04/18/23
3.2 Definition for FA variants
Core Firework: In iterative process, there is fixed number of fireworks which can generate sparks. Among the fireworks in each iteration, the firework with minimal fitness is defined as Core Firework.
![Page 33: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/33.jpg)
33
04/18/2333
3.2 Definition for FA variants
Significance Improvement In order to determine whether the Core Firework can generate better sparks,
we define that if it generates a spark in the next generation whose fitness is Best Fitness in the next iteration as Significance Improvement.
![Page 34: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/34.jpg)
34
04/18/23
3.2 Definition for FA variants
![Page 35: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/35.jpg)
35
04/18/23
3.3 FA with fixed minimal explosion amplitude
![Page 36: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/36.jpg)
36
04/18/23
3.3 FA with fixed minimal explosion amplitude
![Page 37: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/37.jpg)
37
04/18/23
3.3 FA with fixed minimal explosion amplitude
As can be seen, the bigger fixed minimal scope can accelerate the process of searching the optimal solution at the first iterations. However, when it comes to the local minimal space, the higher the fixed minimal scope, the harder it searches the optimal solution.
It would seem that function Ackley is uni-modal function. And multi-modal function is the same, the difference is that only when the swarm comes to a local minimal space rather than a global minimal space compared to uni-modal functions.
![Page 38: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/38.jpg)
38
04/18/23
3.4 FA with dynamic minimal explosion amplitude
Experiments with fixed dynamic explosion amplitude suggest that FA should be loaded with a higher explosion amplitude while it does Not come to a local minimal space, thus to enhance the possibility of obtain a better solution. When it got to a local minimal space, then the fireworks begin to search the Space within a small range from the found good solution.
![Page 39: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/39.jpg)
39
04/18/23
3.4 FA with dynamic minimal explosion amplitude
If FA have not get any better
positions in N consecutive steps?
![Page 40: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/40.jpg)
40
04/18/23
3.4 Two cases:
the population of the swarm (excluding the core firework) is too small.
the search range of the core firework is too small
LOW DIVERSITY
![Page 41: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/41.jpg)
41
04/18/23
3.4 Dynamic minimal explosion amplitude strategy
A better position : B
A
C
Yes, it finds a better solution at BSo it load with the smallest explosion amplitude
Iteration by iteration, it can not obtain any improvement, so a bigger explosion amplitudeShould be exploited till it reaches point C.
![Page 42: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/42.jpg)
42
04/18/23
3.4 FA with dynamic minimal explosion amplitude
Repeat
Minimal Explosion Amplitude Checking
![Page 43: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/43.jpg)
43
04/18/23
3.4 FA with dynamic minimal explosion amplitude
25 BenchmarkTest Functions
![Page 44: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/44.jpg)
44
04/18/23
3.4 FA with dynamic minimal explosion amplitude
ExperimentalResults of FA-DEAon f1-f14
![Page 45: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/45.jpg)
45
04/18/23
3.4 FA with dynamic minimal explosion amplitude
ExperimentalResults of FA-DEAon f15-f25
![Page 46: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/46.jpg)
46
04/18/23
Performance Comparison on Various Dimensions
![Page 47: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/47.jpg)
47
04/18/23
4. Application Research
4.1 FA for NMF
4.2 FA for Clustering
![Page 48: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/48.jpg)
48
04/18/23
4.1 FA for NMF
4.1.1 NMF description
4.1.2 Algorithm for NMF Computing
4.1.3 Experimental results
![Page 49: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/49.jpg)
49
04/18/23
4.1.1 NMF description
Lee and Seung publish a paper on Nature in 1999 about the property.
Low-rank approximations are utilized in several content based retrieval and data mining applications.
![Page 50: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/50.jpg)
50
04/18/23
4.1.1 NMF description
Figure - Scheme of very coarse NMF approximation with very low rank k. Although k is significantly smaller than m and n, the typical structure of the original data matrix can be retained (note the three different groups of data objects in the left, middle, and right part of A).
Minimal
![Page 51: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/51.jpg)
51
04/18/23
4.1.1 NMF description
Mathematically, we consider the problem of finding a “good” (ideally the global) solution of an optimization problem with bound constraints .
![Page 52: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/52.jpg)
52
04/18/23
4.1.1 NMF description
The nonlinear optimization problem underlying NMF can generally be stated as
2, ,
1min ( , ) min || || .
2W H W H Ff W H A WH
![Page 53: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/53.jpg)
53
04/18/23
4.1.2 Algorithm for NMF Computing
Figure – Illustration of the optimization process for row l of the NMF factor W. The lthrow of A (al
r) and all columns of H0 are the input for the optimization algorithms. The output is a row-vector wl
r (the lthrow of W) which minimizes the norm of dlr,
the lthrow of the distance matrix D. The norm of dlr is the fitness function for the
optimization algorithms (minimization problem).
kk
m≈
n
m
0r rll lrH d a w
0lrHwr
larlw
0H
W
![Page 54: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/54.jpg)
54
04/18/23
4.1.2 Algorithm for NMF Computing
General structure of NMF algorithms
![Page 55: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/55.jpg)
55
04/18/23
4.1.2 Algorithm for NMF Computing
NMF Initialization
![Page 56: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/56.jpg)
56
04/18/23
4.1.2 Algorithm for NMF Computing
Iterative Optimization
![Page 57: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/57.jpg)
57
04/18/23
4.1.2 Datasets for NMF Computing by FA
DS-RAND is a randomly created, fully dense matrix which is used in order to provide unbiased results. To evaluate the proposed methods in a classification context we further used two data sets from the area of email classification (spam/phishing detection).
Data set DS-SPAM1 consists of 3000 e-mail messages described by 133 features, divided into three groups: spam, phishing and legitimate email.
Data set DS-SPAM2 is the spambase data set taken from (Kjellerstrand 2011) which consists of 1813 spam and 2788 non-spam messages. DS-SPAM1 represents a ternary classification problem; DS-SPAM2 represents a typical binary classification problem.
![Page 58: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/58.jpg)
58
04/18/23
Figure 4.1.1 – Left hand-side: average approximation error per row (after initializing rows of W). Right hand-side: average approximation error per column (after initializing of H). NMF rank k = 5. Legends are ordered according to approximation error (top = worst, bottom = best).
First W First H
![Page 59: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/59.jpg)
59
04/18/23
Figure 4.1.2 Accuracy per Iteration when updating only the row of W, m=2, c=20. Left: k=2, right: k=5
![Page 60: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/60.jpg)
60
04/18/23
Experiments results of NMF
Figure 4.1.3 – Proportional runtimes for achieving the same accuracy as basic MU after 30 iterations for different values of k when updating only the rows of W. (m=2, c=20)
![Page 61: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/61.jpg)
61
04/18/23
4.2 FA for Document Clustering
4.2.1 Document Clustering Description
4.2.2 Dataset
4.2.3 Experimental Result
![Page 62: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/62.jpg)
62
04/18/23
4.2.1 Document Clustering description
Automatically group the related documents into clusters.
• Example– Medical documents– Legal documents– Financial documents
If a collection is well clustered, it is much more efficient to search only the cluster that will contain relevant documents .
![Page 63: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/63.jpg)
63
04/18/23
4.2.2 Dataset: Newsgroups-18828
predecessor : Newsgroups The 4.5% document belongs to the two or more
than two news group The remaining documents only belongs to one
newsgroupmodification : Jason Rennie from MIT do some
necessary processings to Newsgroups, so that each document belongs to only one News group
characters : A total of 18828 documents, all documents belong to 20 different new newsgroups
widely used in document classification and clustering
![Page 64: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/64.jpg)
4.2.3. Experimental Result
![Page 65: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/65.jpg)
65
04/18/23
Concluding Remarks
By mimicking the explosion process of fireworks in our festivals, the so-called FA is proposed and implemented for function optimization, with a promising performance against Clonal PSO and Standard PSO.
FA-DEA, by introducing an explosion amplitude control strategy, has shown its great advantages in hybrid-modal problems, which can achieve the optima 50% on average.
The use of Firework Algorithm to solve practical engineering and scientific problems like clustering and NMF has gained great success compared to traditional methods.
![Page 66: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/66.jpg)
66
04/18/23
Acknowledgment
This work was supported by National Natural Science Foundation of China (NSFC), under Grant No. 60875080, 60673020, and partially supported by the 863 Program with Grant No. 2007AA01Z453.
Greatly appreciate my Ph.D. students, Zhu Yuanchun and Zheng Shaoqiu, for their excellent contributions and extensive experiments.
Many thanks go to my Postdoc Dr. Andreas Janecek from Univ. of Vienna, and my M.S. students, Yang Xiang and Chao Rui for their significant application researches on FA.
![Page 67: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/67.jpg)
67
04/18/23
Reference[1] Y. Tan, Y. Zhu (2010). Fireworks algorithm for optimization. ICSI 2010, Part I,
Springer LNCS 6145, pp. 355-364[2] S.Q. Zheng, Y. Tan (2011). Fireworks Algorithm with Dynamic Explosion
Amplitude. Submitted to IEEE CEC 2012.[3] A. Janecek and Y. Tan, "Using Population Based Algorithms for Initializing
Nonnegative Matrix Factorization,"Proc. of The Second International Conference on Swarm Intelligence (ICSI’2011), June 12-15, Chongqing, China, 2011. Part II, LNCS 6729, Springer-Verlag, 2011, pp.307-316.
[4] A. Janecek and Y. Tan, "Iterative Improvement of the Multiplicative Update NMF Algorithm using Nature-inspired Optimization,“ The 7th International Conference on Natural Computation (ICNC’11), 26-28 July 2011, Shanghai, China, Springer LNCS, pp.1668 - 1672
[5] A. Janecek, Y. Tan, " Swarm Intelligence for Non-negative Matrix Factorization," International Journal of Swarm Intelligence Research (IJSIR), November 2011 (In press)
[6] X. Yang, Using Fireworks Algorithm for Document Clustering, Bachelor Thesis, Peking University, 2011.
![Page 68: Advance in Fireworks Algorithm and its Applications Ying Tan ( 谭营 ) Peking University Contact ytan@pku.edu.cn This PPT is available](https://reader033.vdocuments.us/reader033/viewer/2022061518/56649ce25503460f949ad4a3/html5/thumbnails/68.jpg)
Thank you
Any Question ?