![Page 1: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/1.jpg)
Universityof Illinois
http://iacoma.cs.uiuc.edu/
LeadOut: Composing Low-Overhead Techniques for Single-Thread Performance
Brian Greskamp, Ulya Karpuzcu, Josep Torrellas
![Page 2: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/2.jpg)
100
1000
10000
100000
19
93
19
94
19
95
19
96
19
97
19
98
19
99
20
00
20
01
20
02
20
03
20
04
20
05
20
06
20
07
20
08
20
09
20
10
20
11
20
12
Year
100
1K
10K
100KTo
p SP
ECin
t92
Rat
e
Ulya Karpuzcu LeadOut
Per-Thread Performance Trend
2
![Page 3: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/3.jpg)
100
1000
10000
100000
19
93
19
94
19
95
19
96
19
97
19
98
19
99
20
00
20
01
20
02
20
03
20
04
20
05
20
06
20
07
20
08
20
09
20
10
20
11
20
12
Year
100
1K
10K
100KTo
p SP
ECin
t92
Rat
e
Ulya Karpuzcu LeadOut
Per-Thread Performance Trend
2
Historical
![Page 4: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/4.jpg)
100
1000
10000
100000
19
93
19
94
19
95
19
96
19
97
19
98
19
99
20
00
20
01
20
02
20
03
20
04
20
05
20
06
20
07
20
08
20
09
20
10
20
11
20
12
Year
100
1K
10K
100KTo
p SP
ECin
t92
Rat
e
Ulya Karpuzcu LeadOut
Per-Thread Performance Trend
2
Historical
Contemporary
![Page 5: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/5.jpg)
Ulya Karpuzcu LeadOut
Near-Future CMP Environment
3
![Page 6: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/6.jpg)
Ulya Karpuzcu LeadOut
Near-Future CMP Environment
3
• Sequential applications need fast cores
![Page 7: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/7.jpg)
Ulya Karpuzcu LeadOut
Near-Future CMP Environment
3
• Sequential applications need fast cores
• Throughput applications demand more cores
![Page 8: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/8.jpg)
Ulya Karpuzcu LeadOut
Near-Future CMP Environment
3
• Sequential applications need fast cores
• Throughput applications demand more cores
• Amdahl’s Law: Most applications need some fast cores
![Page 9: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/9.jpg)
Ulya Karpuzcu LeadOut
Near-Future CMP Environment
3
• Sequential applications need fast cores
• Throughput applications demand more cores
• Amdahl’s Law: Most applications need some fast cores
• Faster cores without compromising core count?
![Page 10: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/10.jpg)
Ulya Karpuzcu LeadOut
Near-Future CMP Environment
3
• Sequential applications need fast cores
• Throughput applications demand more cores
• Amdahl’s Law: Most applications need some fast cores
• Faster cores without compromising core count?
• Configurable Timing Speculation
![Page 11: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/11.jpg)
Ulya Karpuzcu LeadOut
Near-Future CMP Environment
3
• Sequential applications need fast cores
• Throughput applications demand more cores
• Amdahl’s Law: Most applications need some fast cores
• Faster cores without compromising core count?
• Configurable Timing Speculation
• V/f Boosting
![Page 12: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/12.jpg)
Ulya Karpuzcu LeadOut
Timing Speculation (TS)
4
![Page 13: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/13.jpg)
Ulya Karpuzcu LeadOut
Timing Speculation (TS)
4
Boost core frequency beyond nominal at constant supply voltage
![Page 14: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/14.jpg)
Ulya Karpuzcu LeadOut
Err
or
Rate
(P
E)
FreqP
erf
orm
an
ce
Freq
Timing Speculation (TS)
4
Boost core frequency beyond nominal at constant supply voltage
![Page 15: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/15.jpg)
Ulya Karpuzcu LeadOut
Err
or
Rate
(P
E)
FreqP
erf
orm
an
ce
Freq
Timing Speculation (TS)
4
Rat
ed
Rat
ed
Boost core frequency beyond nominal at constant supply voltage
![Page 16: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/16.jpg)
Ulya Karpuzcu LeadOut
Err
or
Rate
(P
E)
FreqP
erf
orm
an
ce
Freq
Timing Speculation (TS)
4
TSTS
• Increase f at constant V
Rat
ed
Rat
ed
Boost core frequency beyond nominal at constant supply voltage
![Page 17: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/17.jpg)
Ulya Karpuzcu LeadOut
Err
or
Rate
(P
E)
FreqP
erf
orm
an
ce
Freq
Timing Speculation (TS)
4
TSTS
• Increase f at constant V
Rat
ed
Rat
edTiming errors
Boost core frequency beyond nominal at constant supply voltage
![Page 18: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/18.jpg)
Ulya Karpuzcu LeadOut
Err
or
Rate
(P
E)
FreqP
erf
orm
an
ce
Freq
Timing Speculation (TS)
4
TSTS
• Increase f at constant V• Support for error detection and correction
Rat
ed
Rat
edTiming errors
Boost core frequency beyond nominal at constant supply voltage
![Page 19: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/19.jpg)
Ulya Karpuzcu LeadOut
Err
or
Rate
(P
E)
FreqP
erf
orm
an
ce
Freq
Timing Speculation (TS)
4
Gain
TSTS
• Increase f at constant V• Support for error detection and correction
Rat
ed
Rat
edTiming errors
Boost core frequency beyond nominal at constant supply voltage
![Page 20: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/20.jpg)
Ulya Karpuzcu LeadOut
Err
or
Rate
(P
E)
FreqP
erf
orm
an
ce
Freq
Timing Speculation (TS)
4
Gain
TSTS
• Increase f at constant V• Support for error detection and correction
Rat
ed
Rat
edTiming errors
Boost core frequency beyond nominal at constant supply voltage
Assuming a high P/T headroom, PE limits performance gain
![Page 21: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/21.jpg)
Ulya Karpuzcu LeadOut
Err
or
Rate
(P
E)
FreqP
erf
orm
an
ce
Freq
Timing Speculation (TS)
4
Gain
TSTS
• Increase f at constant V• Support for error detection and correction
Rat
ed
Rat
edTiming errors
Boost core frequency beyond nominal at constant supply voltage
Assuming a high P/T headroom, PE limits performance gain
![Page 22: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/22.jpg)
Ulya Karpuzcu LeadOut 5
Voltage-Frequency Boosting
![Page 23: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/23.jpg)
Ulya Karpuzcu LeadOut 5
Voltage-Frequency BoostingBoost core frequency beyond nominal by increasing V
![Page 24: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/24.jpg)
Ulya Karpuzcu LeadOut 5
Voltage-Frequency BoostingBoost core frequency beyond nominal by increasing V No timing errors (PE = 0)
![Page 25: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/25.jpg)
Ulya Karpuzcu LeadOut 5
Voltage-Frequency BoostingBoost core frequency beyond nominal by increasing V No timing errors (PE = 0)
FreqPe
rfor
man
ceP E
Freq
![Page 26: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/26.jpg)
Ulya Karpuzcu LeadOut 5
Voltage-Frequency BoostingBoost core frequency beyond nominal by increasing V No timing errors (PE = 0)
FreqPe
rfor
man
ceP E
Freq
Rated
![Page 27: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/27.jpg)
Ulya Karpuzcu LeadOut 5
Voltage-Frequency BoostingBoost core frequency beyond nominal by increasing V No timing errors (PE = 0)
FreqPe
rfor
man
ceP E
Freq
Rated V/f Boosting
![Page 28: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/28.jpg)
Ulya Karpuzcu LeadOut 5
Voltage-Frequency BoostingBoost core frequency beyond nominal by increasing V No timing errors (PE = 0)
FreqPe
rfor
man
ceP E
Freq
Rated V/f Boosting
Gai
n
![Page 29: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/29.jpg)
Ulya Karpuzcu LeadOut 5
Voltage-Frequency BoostingBoost core frequency beyond nominal by increasing V No timing errors (PE = 0)
FreqPe
rfor
man
ceP E
Freq
Rated V/f Boosting
Gai
n
Assuming a high P/T headroom, V limits performance gain
![Page 30: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/30.jpg)
Ulya Karpuzcu LeadOut 6
Contribution: LeadOut
![Page 31: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/31.jpg)
Ulya Karpuzcu LeadOut 6
• Individual application of TS or V/f Boosting is suboptimal
Contribution: LeadOut
![Page 32: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/32.jpg)
Ulya Karpuzcu LeadOut 6
• Individual application of TS or V/f Boosting is suboptimal
• Unable to bring the multicore up to its P/T envelope
Contribution: LeadOut
![Page 33: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/33.jpg)
Ulya Karpuzcu LeadOut 6
• Individual application of TS or V/f Boosting is suboptimal
• Unable to bring the multicore up to its P/T envelope
• Available P/T headroom remains untapped
Contribution: LeadOut
![Page 34: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/34.jpg)
Ulya Karpuzcu LeadOut 6
• Individual application of TS or V/f Boosting is suboptimal
• Unable to bring the multicore up to its P/T envelope
• Available P/T headroom remains untapped
• TS and V/f boosting are complementary
Contribution: LeadOut
![Page 35: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/35.jpg)
Ulya Karpuzcu LeadOut 6
• Individual application of TS or V/f Boosting is suboptimal
• Unable to bring the multicore up to its P/T envelope
• Available P/T headroom remains untapped
• TS and V/f boosting are complementary
• Bounded by different constraints
Contribution: LeadOut
![Page 36: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/36.jpg)
Ulya Karpuzcu LeadOut 6
• Individual application of TS or V/f Boosting is suboptimal
• Unable to bring the multicore up to its P/T envelope
• Available P/T headroom remains untapped
• TS and V/f boosting are complementary
• Bounded by different constraints
• LeadOut
Contribution: LeadOut
![Page 37: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/37.jpg)
Ulya Karpuzcu LeadOut 6
• Individual application of TS or V/f Boosting is suboptimal
• Unable to bring the multicore up to its P/T envelope
• Available P/T headroom remains untapped
• TS and V/f boosting are complementary
• Bounded by different constraints
• LeadOut
• Synergistically combine TS and V/f Boosting
Contribution: LeadOut
![Page 38: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/38.jpg)
Ulya Karpuzcu LeadOut 6
• Individual application of TS or V/f Boosting is suboptimal
• Unable to bring the multicore up to its P/T envelope
• Available P/T headroom remains untapped
• TS and V/f boosting are complementary
• Bounded by different constraints
• LeadOut
• Synergistically combine TS and V/f Boosting
• Speed-ups for single thread performance multiply
Contribution: LeadOut
![Page 39: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/39.jpg)
Ulya Karpuzcu LeadOut
Example TS Architecture [PACT07]: Paceline
7
Many-Core CMP
![Page 40: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/40.jpg)
Ulya Karpuzcu LeadOut
OS sees: One core
8
CheckerLeader
Example TS Architecture [PACT07]: Paceline
![Page 41: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/41.jpg)
Ulya Karpuzcu LeadOut
Critical ThreadOS sees: One core
8
CheckerLeader
Example TS Architecture [PACT07]: Paceline
![Page 42: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/42.jpg)
Ulya Karpuzcu LeadOut
Critical ThreadOS sees: One core
8
CheckerLeader
Example TS Architecture [PACT07]: Paceline
![Page 43: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/43.jpg)
Ulya Karpuzcu LeadOut 9
Leader Checker
Example TS Architecture [PACT07]: Paceline
![Page 44: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/44.jpg)
Ulya Karpuzcu LeadOut 9
Leader CheckerSpeculative Clock Rated ClockExample TS Architecture [PACT07]: Paceline
![Page 45: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/45.jpg)
Ulya Karpuzcu LeadOut 9
Leader CheckerSpeculative Clock Rated Clock
=?
Example TS Architecture [PACT07]: Paceline
![Page 46: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/46.jpg)
Ulya Karpuzcu LeadOut 9
Leader CheckerSpeculative Clock Rated Clock
=?=?
Example TS Architecture [PACT07]: Paceline
![Page 47: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/47.jpg)
Ulya Karpuzcu LeadOut 9
Leader CheckerSpeculative Clock Rated Clock
=?=?
Example TS Architecture [PACT07]: Paceline
![Page 48: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/48.jpg)
Ulya Karpuzcu LeadOut 9
Leader CheckerSpeculative Clock Rated Clock
=?=?=?
Example TS Architecture [PACT07]: Paceline
![Page 49: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/49.jpg)
Rated Clock Rated Clock
=?
Thread 0 Thread 1
OS sees: Two cores
Ulya Karpuzcu LeadOut 10
Example TS Architecture [PACT07]: Paceline
![Page 50: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/50.jpg)
Ulya Karpuzcu LeadOut 11
Cor
e 0
Example V/f Boosting: Intel Turbo Boost
![Page 51: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/51.jpg)
Ulya Karpuzcu LeadOut 11
Nominal
Freq
uenc
y
Cor
e 0
Cor
e 1
Cor
e 2
Cor
e 3
Cor
e 0
Example V/f Boosting: Intel Turbo Boost
![Page 52: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/52.jpg)
Ulya Karpuzcu LeadOut 11
Nominal
Freq
uenc
y
Cor
e 0
Cor
e 1
Cor
e 2
Cor
e 3
Lightly Threaded Workload
Turbo
Cor
e 0
Example V/f Boosting: Intel Turbo Boost
![Page 53: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/53.jpg)
Ulya Karpuzcu LeadOut 11
Nominal
Freq
uenc
y
Cor
e 0
Cor
e 1
Cor
e 2
Cor
e 3
Lightly Threaded Workload
Turbo
Cor
e 0
Freq
uenc
y
Cor
e 0
Cor
e 1
Cor
e 2
Cor
e 3
Example V/f Boosting: Intel Turbo Boost
![Page 54: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/54.jpg)
Ulya Karpuzcu LeadOut 11
Nominal
Freq
uenc
y
Cor
e 0
Cor
e 1
Cor
e 2
Cor
e 3
Lightly Threaded Workload
Turbo
Cor
e 0
Freq
uenc
y
Cor
e 0
Cor
e 1
Cor
e 2
Cor
e 3Inactive cores
power-gated
Example V/f Boosting: Intel Turbo Boost
![Page 55: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/55.jpg)
Ulya Karpuzcu LeadOut 11
Nominal
Freq
uenc
y
Cor
e 0
Cor
e 1
Cor
e 2
Cor
e 3
Lightly Threaded Workload
Turbo
Cor
e 0
Freq
uenc
y
Cor
e 0
Cor
e 1
Cor
e 2
Cor
e 3Inactive cores
power-gated
Example V/f Boosting: Intel Turbo Boost
![Page 56: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/56.jpg)
Ulya Karpuzcu LeadOut
Composing the Techniques
12
![Page 57: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/57.jpg)
Ulya Karpuzcu LeadOut
Composing the Techniques
12
The techniques are orthogonal
![Page 58: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/58.jpg)
Ulya Karpuzcu LeadOut
Composing the Techniques
• Suppose as much P/T headroom as necessary
12
The techniques are orthogonal
![Page 59: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/59.jpg)
Ulya Karpuzcu LeadOut
Composing the Techniques
• Suppose as much P/T headroom as necessary
• Paceline: Performance gain constrained by PEMAX
12
The techniques are orthogonal
![Page 60: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/60.jpg)
Ulya Karpuzcu LeadOut
Composing the Techniques
• Suppose as much P/T headroom as necessary
• Paceline: Performance gain constrained by PEMAX
• V/f Boosting: Performance gain constrained by VMAX
12
The techniques are orthogonal
![Page 61: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/61.jpg)
Ulya Karpuzcu LeadOut 13
V/f Boosting + Paceline
![Page 62: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/62.jpg)
Ulya Karpuzcu LeadOut 13
Boost core frequency beyond nominal by increasing V; tolerating occasional timing errors
V/f Boosting + Paceline
![Page 63: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/63.jpg)
FreqPe
rfor
man
ceP E
Freq
RatedV/f Boosting
Ulya Karpuzcu LeadOut 13
Boost core frequency beyond nominal by increasing V; tolerating occasional timing errors
V/f Boosting + Paceline
![Page 64: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/64.jpg)
FreqPe
rfor
man
ceP E
Freq
RatedV/f Boosting
Ulya Karpuzcu LeadOut 13
Boost core frequency beyond nominal by increasing V; tolerating occasional timing errors
V/f Boosting + Paceline
V/f Boosting + Paceline
![Page 65: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/65.jpg)
FreqPe
rfor
man
ceP E
Freq
RatedV/f Boosting
Ulya Karpuzcu LeadOut 13
Boost core frequency beyond nominal by increasing V; tolerating occasional timing errors
V/f Boosting + Paceline
V/f Boosting + Paceline
Gai
n
![Page 66: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/66.jpg)
Ulya Karpuzcu LeadOut 14
Composing the Techniques
![Page 67: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/67.jpg)
Ulya Karpuzcu LeadOut 14
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 68: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/68.jpg)
Ulya Karpuzcu LeadOut 15
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 69: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/69.jpg)
Ulya Karpuzcu LeadOut 15
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 70: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/70.jpg)
Ulya Karpuzcu LeadOut 15
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 71: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/71.jpg)
Ulya Karpuzcu LeadOut 15
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 72: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/72.jpg)
Ulya Karpuzcu LeadOut 15
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 73: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/73.jpg)
Ulya Karpuzcu LeadOut 16
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 74: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/74.jpg)
Ulya Karpuzcu LeadOut 16
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 75: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/75.jpg)
Ulya Karpuzcu LeadOut 16
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 76: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/76.jpg)
Ulya Karpuzcu LeadOut 16
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 77: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/77.jpg)
Ulya Karpuzcu LeadOut 16
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 78: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/78.jpg)
Ulya Karpuzcu LeadOut 17
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 79: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/79.jpg)
Ulya Karpuzcu LeadOut 17
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 80: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/80.jpg)
Ulya Karpuzcu LeadOut 17
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 81: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/81.jpg)
Ulya Karpuzcu LeadOut 17
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 82: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/82.jpg)
Ulya Karpuzcu LeadOut 17
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
![Page 83: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/83.jpg)
Ulya Karpuzcu LeadOut 17
Multicore Loading
Condition
Bounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding ConstraintsBounding Constraints Gain from combining
?
Multicore Loading
ConditionV/f BoostV/f Boost PacelinePaceline Compos.Compos.
Gain from combining
?
Multicore Loading
Condition T/P V T/P PE T/P V/PE
Gain from combining
?
Very High ✓ ✓ ✓ Unlikely
High to Moderate ✓ ✓ ✓ Likely
Low ✓ ✓ ✓ Definitely
Composing the Techniques
Additional techniques can be applied
![Page 84: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/84.jpg)
Ulya Karpuzcu LeadOut
LeadOut Operation
18
![Page 85: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/85.jpg)
Ulya Karpuzcu LeadOut
LeadOut Operation
18
• At any given time, CMP executes a mix of speed-critical and throughput-oriented threads
![Page 86: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/86.jpg)
Ulya Karpuzcu LeadOut
LeadOut Operation
18
• At any given time, CMP executes a mix of speed-critical and throughput-oriented threads
• Run throughput threads unoptimized
![Page 87: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/87.jpg)
Ulya Karpuzcu LeadOut
LeadOut Operation
18
• At any given time, CMP executes a mix of speed-critical and throughput-oriented threads
• Run throughput threads unoptimized• Optimization Problem
![Page 88: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/88.jpg)
Ulya Karpuzcu LeadOut
LeadOut Operation
18
• At any given time, CMP executes a mix of speed-critical and throughput-oriented threads
• Run throughput threads unoptimized• Optimization Problem
1. Which technique to use for a speed-critical thread?
![Page 89: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/89.jpg)
Ulya Karpuzcu LeadOut
LeadOut Operation
18
• At any given time, CMP executes a mix of speed-critical and throughput-oriented threads
• Run throughput threads unoptimized• Optimization Problem
1. Which technique to use for a speed-critical thread?2. How to optimally set V/f for chosen technique?
![Page 90: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/90.jpg)
Ulya Karpuzcu LeadOut
LeadOut Evaluation
19
![Page 91: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/91.jpg)
Ulya Karpuzcu LeadOut
LeadOut Evaluation
19
• Simulated 32nm CMP with 16 cores
![Page 92: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/92.jpg)
Ulya Karpuzcu LeadOut
LeadOut Evaluation
19
• Simulated 32nm CMP with 16 cores • Detailed modeling of leakage, temperature, variation
![Page 93: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/93.jpg)
Ulya Karpuzcu LeadOut
LeadOut Evaluation
19
• Simulated 32nm CMP with 16 cores • Detailed modeling of leakage, temperature, variation • Applications: SPECint2000 benchmarks
![Page 94: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/94.jpg)
Ulya Karpuzcu LeadOut
LeadOut Evaluation
19
• Simulated 32nm CMP with 16 cores • Detailed modeling of leakage, temperature, variation • Applications: SPECint2000 benchmarks• 50 Monte Carlo die samples
![Page 95: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/95.jpg)
Ulya Karpuzcu LeadOut 20
Power-Performance TradeoffPe
r Cor
e Po
wer
(W)
Performance
Increasing Load4
6
8
10
12
11
13
14
1 1.1 1.2 1.3 1.4
Unoptimized
Paceline
V/f-Boost
V/f-Boost + Paceline
![Page 96: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/96.jpg)
Ulya Karpuzcu LeadOut 21
Power-Performance TradeoffPe
r Cor
e Po
wer
(W)
Performance
Increasing Load4
6
8
10
12
11
13
14
1 1.1 1.2 1.3 1.4
Unoptimized
Paceline
V/f-Boost
V/f-Boost + Paceline
![Page 97: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/97.jpg)
Ulya Karpuzcu LeadOut 22
Power-Performance TradeoffPe
r Cor
e Po
wer
(W)
Performance
Increasing Load4
6
8
10
12
11
13
14
1 1.1 1.2 1.3 1.4
Unoptimized
Paceline
V/f-Boost
V/f-Boost + Paceline
![Page 98: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/98.jpg)
Ulya Karpuzcu LeadOut 23
Power-Performance TradeoffPe
r Cor
e Po
wer
(W)
Performance
Increasing Load4
6
8
10
12
11
13
14
1 1.1 1.2 1.3 1.4
Unoptimized
Paceline
V/f-Boost
V/f-Boost + Paceline
![Page 99: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/99.jpg)
Ulya Karpuzcu LeadOut 23
Power-Performance TradeoffPe
r Cor
e Po
wer
(W)
Performance
Increasing Load4
6
8
10
12
11
13
14
1 1.1 1.2 1.3 1.4
Unoptimized
Paceline
V/f-Boost
V/f-Boost + Paceline
~20% speed-up at most at 2x power cost
![Page 100: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/100.jpg)
Ulya Karpuzcu LeadOut 24
Power-Performance TradeoffPe
r Cor
e Po
wer
(W)
Performance
Increasing Load4
6
8
10
12
11
13
14
1 1.1 1.2 1.3 1.4
Unoptimized
Paceline
V/f-Boost
V/f-Boost + Paceline
![Page 101: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/101.jpg)
Ulya Karpuzcu LeadOut 24
Power-Performance TradeoffPe
r Cor
e Po
wer
(W)
Performance
Increasing Load4
6
8
10
12
11
13
14
1 1.1 1.2 1.3 1.4
Unoptimized
Paceline
V/f-Boost
V/f-Boost + Paceline
20% speed-up at most at 2x power cost
38% speed-up at most at 3x power cost
![Page 102: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/102.jpg)
Ulya Karpuzcu LeadOut 25
Power-Performance TradeoffPe
r Cor
e Po
wer
(W)
Performance
Increasing Load4
6
8
10
12
11
13
14
1 1.1 1.2 1.3 1.4
Unoptimized
Paceline
V/f-Boost
V/f-Boost + Paceline
The techniques are orthogonal
![Page 103: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/103.jpg)
Ulya Karpuzcu LeadOut 26
Also in the Paper
![Page 104: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/104.jpg)
Ulya Karpuzcu LeadOut
• Detailed analysis for different load conditions
26
Also in the Paper
![Page 105: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/105.jpg)
Ulya Karpuzcu LeadOut
• Detailed analysis for different load conditions
• Including V/f Boosting with activity migration
26
Also in the Paper
![Page 106: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/106.jpg)
Ulya Karpuzcu LeadOut
• Detailed analysis for different load conditions
• Including V/f Boosting with activity migration
• Sensitivity analysis
26
Also in the Paper
![Page 107: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/107.jpg)
Ulya Karpuzcu LeadOut
• Detailed analysis for different load conditions
• Including V/f Boosting with activity migration
• Sensitivity analysis
• Thermal design points, power grid designs, guardband
26
Also in the Paper
![Page 108: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/108.jpg)
Ulya Karpuzcu LeadOut
• Detailed analysis for different load conditions
• Including V/f Boosting with activity migration
• Sensitivity analysis
• Thermal design points, power grid designs, guardband
• A hierarchical controller design to dynamically set
26
Also in the Paper
![Page 109: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/109.jpg)
Ulya Karpuzcu LeadOut
• Detailed analysis for different load conditions
• Including V/f Boosting with activity migration
• Sensitivity analysis
• Thermal design points, power grid designs, guardband
• A hierarchical controller design to dynamically set
• Technique to apply
26
Also in the Paper
![Page 110: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/110.jpg)
Ulya Karpuzcu LeadOut
• Detailed analysis for different load conditions
• Including V/f Boosting with activity migration
• Sensitivity analysis
• Thermal design points, power grid designs, guardband
• A hierarchical controller design to dynamically set
• Technique to apply
• Per core V/f assignment for the chosen technique
26
Also in the Paper
![Page 111: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/111.jpg)
Ulya Karpuzcu LeadOut 27
Conclusion
![Page 112: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/112.jpg)
Ulya Karpuzcu LeadOut
• Two low overhead techniques for sequential acceleration
27
Conclusion
![Page 113: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/113.jpg)
Ulya Karpuzcu LeadOut
• Two low overhead techniques for sequential acceleration
• V/f Boosting and Timing Speculation
27
Conclusion
![Page 114: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/114.jpg)
Ulya Karpuzcu LeadOut
• Two low overhead techniques for sequential acceleration
• V/f Boosting and Timing Speculation
• Individual application of any technique suboptimal
27
Conclusion
![Page 115: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/115.jpg)
Ulya Karpuzcu LeadOut
• Two low overhead techniques for sequential acceleration
• V/f Boosting and Timing Speculation
• Individual application of any technique suboptimal
• Techniques are complementary
27
Conclusion
![Page 116: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/116.jpg)
Ulya Karpuzcu LeadOut
• Two low overhead techniques for sequential acceleration
• V/f Boosting and Timing Speculation
• Individual application of any technique suboptimal
• Techniques are complementary
• LeadOut: A highly-configurable CMP
27
Conclusion
![Page 117: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/117.jpg)
Ulya Karpuzcu LeadOut
• Two low overhead techniques for sequential acceleration
• V/f Boosting and Timing Speculation
• Individual application of any technique suboptimal
• Techniques are complementary
• LeadOut: A highly-configurable CMP
• Combining V/f Boosting and TS synergistically
27
Conclusion
![Page 118: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/118.jpg)
Ulya Karpuzcu LeadOut
• Two low overhead techniques for sequential acceleration
• V/f Boosting and Timing Speculation
• Individual application of any technique suboptimal
• Techniques are complementary
• LeadOut: A highly-configurable CMP
• Combining V/f Boosting and TS synergistically
• 34% thread speedup at 220% power increase
27
Conclusion
![Page 119: LeadOut: Composing Low-Overhead Techniques …people.ece.umn.edu/groups/altai/Publications_files/Lead...University of Illinois LeadOut: Composing Low-Overhead Techniques for Single-Thread](https://reader034.vdocuments.us/reader034/viewer/2022051203/5aae61607f8b9a07498c0425/html5/thumbnails/119.jpg)
Universityof Illinois
http://iacoma.cs.uiuc.edu/
LeadOut: Composing Low-Overhead Techniques for Single-Thread Performance
Brian Greskamp, Ulya Karpuzcu, Josep Torrellas