n-tuple s&p patterns across decades, 1950s to 2011 a. g. (tassos) malliaris mary malliaris...
TRANSCRIPT
![Page 1: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/1.jpg)
N-tuple S&P Patterns Across Decades, 1950s to 2011
A. G. (Tassos) Malliaris
Mary MalliarisLOYOLA UNIVERSITY CHICAGO
The Korea Institute of Finance and
The Athenian Policy Forum Conference
Seoul, Korea
June 16-18, 2013
![Page 2: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/2.jpg)
Purpose
• To investigate the Up and Down movements of the S&P 500 from 1950 through 2011
• And to use that information to forecast the direction tomorrow of the S&P 500
![Page 3: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/3.jpg)
Data
• Daily closing prices from 1/3/1950 to 7/19/2011
• Over 15,000 observations
• were transformed into Up [U] or Down [D] by comparing today’s value to yesterday’s
• Up and Down movements were recorded from 1 up to 7 days
![Page 4: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/4.jpg)
Up [U] and Down [D] movements per decade, 1950 through 2011.
![Page 5: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/5.jpg)
Two-Day Patterns Across Decades
![Page 6: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/6.jpg)
Three-Day Patterns
![Page 7: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/7.jpg)
Four to Seven-Day patterns
• Strings were formed, for example, UDDU through DUDUDDU
• From 16 to 128 patterns [too many to display on a slide]
• Columns also created counting the number of Up movements within a string
![Page 8: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/8.jpg)
Number of Ups in Two Days
![Page 9: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/9.jpg)
Number of Ups in Three Days
![Page 10: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/10.jpg)
Number of Ups in Four Days
![Page 11: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/11.jpg)
Number of Ups in Five Days
![Page 12: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/12.jpg)
Forecasting
• Training set: data from January 1950 through December 2009 [15,087 rows].
• Validation set: January 2010 through mid-September 2011 [387 rows]
• Training set patterns were used as inputs for models that were then used to predict the Validation set
![Page 13: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/13.jpg)
Forecasting Methodologies
• Pattern Forecasts with 1 to 7 Days
• Decision Tree
• Neural Network
• Random Forecasts
![Page 14: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/14.jpg)
The Forecast Decision by Pattern, an Example
Training set 4-day patterns
Count
DDUD 760
DDUU 1050
Validation Set Pattern Up through Today
Most Likely Move Tomorrow
DDU U
![Page 15: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/15.jpg)
Decision Tree Forecasts
• Decision Tree Methodology: C5.0
• Software Package: SPSS Modeler
• Target: Tomorrow’s Direction
• Inputs: : the up-down patterns from one to seven days, the number of up days in 1 to five days, and the closing value today
![Page 16: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/16.jpg)
Decision Tree Variable Importance• This Modeler technique also ranks the input
variables in terms of importance, with more important variables occurring higher up on the tree.
• The variables ranked highest in importance to the forecast were
the direction today
the closing value today
the 7-day pattern [for example UDUUDDU]
number of Up movements in the last three days.
![Page 17: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/17.jpg)
Neural Network Forecasts
• Neural Network Methodology: Back Propagation; two hidden layers
• Software Package: SPSS Modeler
• Target: Tomorrow’s Direction
• Inputs included: the up-down patterns from one to seven days, the number of up days in 1 to five days, and the closing value today
![Page 18: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/18.jpg)
Neural Network Variable Importance
• SPSS Modeler also ranks the input variables in terms of their importance to the neural network
• The variables ranked highest in importance with this methodology were
the patterns in the 4 day through 7 day strings
the number of Ups in the past three days
the closing value
![Page 19: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/19.jpg)
Comparing Methods by Calculating Gain or Loss
Daily Gain/Loss Summed Over 387 Days
Change in Index
Actual Direction
Predicted Direction
Amount of Gain/Loss
-5 Down Down 5-5 Down Up -55 Up Down -55 Up Up 5
![Page 20: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/20.jpg)
Random Forecast
• A random number was generated for each day in the validation set
• If the random value was less than .5 then Down was predicted, otherwise the forecast was Up.
• The amount of gain/loss was calculated over the Validation set
• This was repeated 100,000 times
![Page 21: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/21.jpg)
RANDOM WALK SIMULATIONSTotal gains/losses for 100,000 simulated random forecasts for 387 days
Minimum -1028.62Maximum 1048.12Mean -0.0995Std Dev 235.4787
![Page 22: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/22.jpg)
Number of correct directional forecasts for each methodology
Method Down UpNumber Correct
2 Day String 72 123 195
3 Day String 41 164 205
4 Day String 41 164 205
Decision Tree 43 168 211
5 Day String 45 167 212
7 Day String 48 164 212
6 Day String 40 178 218
1 Day String 0 219 219
Neural Net 61 161 222
![Page 23: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/23.jpg)
Total amount gained or lost per strategy, and comparison to the random simulations
Type of ForecastTotal Amount Gained/Lost
Amount as Std Deviations in the Random
Distribution2 Day String -21.08 -0.087Decision Tree 168.16 0.7153 Day String 174.34 0.7424 Day String 174.34 0.7421 Day String 193.96 0.8257 Day String 306.92 1.3035 Day String 307.22 1.3056 Day String 335.84 1.426Neural Net 393.4 1.67
![Page 24: N-tuple S&P Patterns Across Decades, 1950s to 2011 A. G. (Tassos) Malliaris Mary Malliaris LOYOLA UNIVERSITY CHICAGO The Korea Institute of Finance and](https://reader036.vdocuments.us/reader036/viewer/2022062408/56649ec05503460f94bcc35a/html5/thumbnails/24.jpg)
Conclusions• The number of up movements is greater than
down movements across the decades.
• Patterns of Up and Down movement from the past can be useful for forecasting future movement
• The highest gain from simple patterns came from using the 6-day strings
• The neural network, a more complex methodology, yielded the greatest gain