developing insight into effective spsa parameters through ... · developing insight into effective...
TRANSCRIPT
![Page 1: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/1.jpg)
Developing insight into effective SPSA parametersthrough sensitivity analysis
Ioulia MARKOU Constantinos ANTONIOUNational Technical University of Athens, Greece
MT-ITS 2015 3-5. June 2015, Budapest
![Page 2: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/2.jpg)
Outline
Motivation
Overview
Methodology
Experimental set-up
Application and results
Conclusion and future research prospects
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 2
![Page 3: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/3.jpg)
Motivation
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 3
Driving Characteristics
Key factor for transportation systems
Models’ values represent driving and
travel behavior parameters’ diversity
Parameter calibration is a
crucial step
![Page 4: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/4.jpg)
MotivationSimultaneous Perturbation Stochastic Approximation
SPSA
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 4
An optimization method that has attracted considerable international attention
Its performance depends on the appropriate set of parameters
![Page 5: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/5.jpg)
Overview
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 5
Macroscopic, mesoscopic and microscopic traffic flow models
Their default parameter values are not suitable for all applications
Driving and travel behavior parameters are constantly changing
Calibration procedure aims to appropriately specify the modelparameter values, so that the representation of the network and trafficflow characteristics is as accurate as the model structure allows
![Page 6: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/6.jpg)
Overview
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 6
Formulation as an optimization problem
Optimization algorithms
Least-squares method Deterministic Complex algorithm of Box Nelder-Mead algorithm … Stochastic approximation
S - imultaneousP - erturbationS - tochasticA - pproximation
Spall, J. C. (1998)
![Page 7: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/7.jpg)
Overview
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 7
Member of the iterative stochastic optimization algorithms family
Applicable solution when the objective function does not have an analytical form
Saves computational time for large-scale problems over traditional gradient methods
1SPSA, 2SPSA, W–SPSA, c–SPSA, etc.
SPSA Algorithm
![Page 8: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/8.jpg)
Overview
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 8
SPSA Algorithm
![Page 9: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/9.jpg)
Overview
aA
alphac
gamma
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 6
SPSA Algorithm
![Page 10: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/10.jpg)
Methodology
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 6
Determination of calibration parameters
Collection of historical measurements
Selection of calibration algorithm
Choice of Loss Function
Start of Calibration
![Page 11: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/11.jpg)
Experimental set-up
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 11
Ozguven and Ozbay (2008)
![Page 12: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/12.jpg)
Application
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 12
RMSNusing the suggested
SPSA parameter
values
![Page 13: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/13.jpg)
Application
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 13
Parameter a
RM
SN
0,4
0,3
0,2
0,1
0
a = 2a = 0,01 a = 5 a = 10a = 7a = 0,5
![Page 14: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/14.jpg)
Application
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 14
Parameter alpha
RM
SN
0,4
0,3
0,2
0,1
0
alpha = 0,3 alpha = 0,4 alpha = 0,5 alpha = 0,6 alpha = 0,8 alpha = 1
![Page 15: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/15.jpg)
Application
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 15
Sensitivity analysis of the three important parameters
![Page 16: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/16.jpg)
Results
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 16
![Page 17: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/17.jpg)
Conclusion
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 17
Certain parameters significantly affect SPSA’s convergence
The parameter c does not appear to improve convergence
Parameters alpha, gamma and a seem to contribute
significantly to the convergence of the algorithm.
![Page 18: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/18.jpg)
Future research prospects
MT-ITS 2015 3-5. JUNE 2015, BUDAPEST 18
Further experimental analysis Larger problems Different noise structures Dynamic phenomena
Application in other SPSA variants (e.g. W-SPSA, c-SPSA)
![Page 19: Developing insight into effective SPSA parameters through ... · Developing insight into effective SPSA parameters through sensitivity analysis Ioulia MARKOU Constantinos ANTONIOU](https://reader034.vdocuments.us/reader034/viewer/2022042812/5faee336d64e724f694ad457/html5/thumbnails/19.jpg)
Developing insight into effective SPSA parametersthrough sensitivity analysis
Ioulia MARKOU Constantinos ANTONIOU
National Technical University of Athens, Greece
MT-ITS 2015 3-5. June 2015, Budapest