whole brain emulation, as a platform for creating safe agi
DESCRIPTION
Whole Brain Emulation, as a platform for creating safe AGI. Anna Salamon and Carl Shulman. Outline. Background AGI volatility Why risky WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?. Outline. Background AGI volatility - PowerPoint PPT PresentationTRANSCRIPT
![Page 1: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/1.jpg)
Whole Brain Emulation, as a platform for creating safe AGI
Anna Salamon and Carl Shulman
![Page 2: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/2.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 3: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/3.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 4: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/4.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 5: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/5.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 6: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/6.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 7: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/7.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 8: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/8.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 9: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/9.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 10: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/10.jpg)
AGI: More change, faster
![Page 11: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/11.jpg)
AGIs can be copied
![Page 12: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/12.jpg)
AGIs can be copied
![Page 13: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/13.jpg)
Serial speedup
![Page 14: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/14.jpg)
Serial speedup
![Page 15: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/15.jpg)
Solving coordination problems
![Page 16: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/16.jpg)
Recursive self-improvement
![Page 17: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/17.jpg)
Recursive self-improvement
![Page 18: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/18.jpg)
Recursive self-improvement
![Page 19: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/19.jpg)
![Page 20: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/20.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 21: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/21.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 22: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/22.jpg)
Intelligence + Goals= Change
![Page 23: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/23.jpg)
More intelligence → More change
![Page 24: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/24.jpg)
More intelligence → more change
![Page 25: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/25.jpg)
Most ways of rearranging our world would kill us
![Page 26: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/26.jpg)
Values vary starkly
![Page 27: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/27.jpg)
Arbitrary, rewirable receptors
![Page 28: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/28.jpg)
Threading the needle
![Page 29: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/29.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 30: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/30.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 31: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/31.jpg)
Copying specific individuals
![Page 32: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/32.jpg)
![Page 33: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/33.jpg)
WBEs share our values
![Page 34: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/34.jpg)
WBEs share our values
![Page 35: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/35.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 36: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/36.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 37: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/37.jpg)
WBEs can also make AGIs. Faster.
![Page 38: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/38.jpg)
Eventually
WBEs
AGIstable
cessation of research
![Page 39: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/39.jpg)
WBEs can't rapidly self-improve
![Page 40: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/40.jpg)
But can try variations
![Page 41: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/41.jpg)
Copy what works
![Page 42: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/42.jpg)
Save states can improve work skills
SaveRestore
![Page 43: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/43.jpg)
... and stabilize goals
SaveRestore
![Page 44: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/44.jpg)
Single “upload clans” could take over
![Page 45: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/45.jpg)
Single “upload clans” could take over
![Page 46: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/46.jpg)
... or invent powerful AI
![Page 47: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/47.jpg)
... or invent powerful AI
![Page 48: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/48.jpg)
Values also lost through competition
See Nick Bostrom's "The Future of Human Evolution," http://www.nickbostrom.com/fut/evolution.html
![Page 49: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/49.jpg)
Fun
Happiness
Humangenes
Love
Play
Jobskills
Values also lost through competition
![Page 50: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/50.jpg)
business as usual
human extinction
stable totalitarianism
controlled intelligence explosion
uncontrolled intelligence explosion
![Page 51: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/51.jpg)
business as usual
human extinction
stable totalitarianism
controlled intelligence explosion
uncontrolled intelligence explosion
WBEs
![Page 52: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/52.jpg)
So: is our shot better or worse with WBE?
![Page 53: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/53.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 54: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/54.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 55: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/55.jpg)
WBE can ease coordination
![Page 56: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/56.jpg)
Races incentivize risk-taking
![Page 57: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/57.jpg)
Safety infrastructure could be designed ahead of time
![Page 58: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/58.jpg)
Arms races and time for precautions
1940 1950 1960 1970
Year of first nuclear testUS
1945USSR1949
UK1952
France1960
PRC1964
![Page 59: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/59.jpg)
Forever in a day
1940 1950 1960 1970
USSR1949
UK1952
France1960
PRC1964
July 16,1945
July 17,1945
July 18,1945
July 19,1945
![Page 60: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/60.jpg)
WBE as platform for further tech development
![Page 61: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/61.jpg)
The possibility of a highly-controlled structure
![Page 62: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/62.jpg)
Carefully chosen, tested components
![Page 63: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/63.jpg)
Safety infrastructure could be designed ahead of time
![Page 64: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/64.jpg)
... and stabilize goals
SaveRestore
![Page 65: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/65.jpg)
Moral objections?
![Page 66: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/66.jpg)
Even without “WBE systems”, advantages to WBEs
![Page 67: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/67.jpg)
Reduced coordination problems
![Page 68: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/68.jpg)
Taking the long view
![Page 69: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/69.jpg)
Existence proof
?
![Page 70: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/70.jpg)
WBE can ease the technical challenge
![Page 71: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/71.jpg)
Subjectively slower computers
![Page 72: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/72.jpg)
Moore's Law of Mad Science"Every eighteen months, the IQ required to destroy the world drops by one point." —Eliezer Yudkowsky
![Page 73: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/73.jpg)
WBE safety monitors: as fast and numerous as AIs
![Page 74: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/74.jpg)
WBE safety monitors: as fast and numerous as AIs
![Page 75: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/75.jpg)
Cognitive enhancement for WBEs
![Page 76: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/76.jpg)
But modified WBE can become inhuman fast
![Page 77: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/77.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 78: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/78.jpg)
Outline Background
AGI volatility Why risky
WBEs Whole Brain Emulation (WBE) WBE not stable But may help to build safe AI Can we make WBE come first?
![Page 79: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/79.jpg)
Can we make WBE come first?
![Page 80: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/80.jpg)
Inputs to WBE
Hardware Brain imaging Computational neuroscience
![Page 81: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/81.jpg)
Hard to budge Moore's law And if we succeed, we accelerate AGI, too
![Page 82: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/82.jpg)
Could automate brain imaging
![Page 83: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/83.jpg)
Neuroscience models most likely bottleneck
Hardware Brain imaging Computational neuroscience
![Page 84: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/84.jpg)
But same inputs also speed up brain-like AI
Hardware Brain imaging Computational neuroscience
![Page 85: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/85.jpg)
How much boost each way?
?
![Page 86: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/86.jpg)
WBE from partially controlled AI
![Page 87: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/87.jpg)
So, what shall we do?
![Page 88: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/88.jpg)
business as usual
human extinction
stable totalitarianism
controlled intelligence explosion
uncontrolled intelligence explosion
![Page 89: Whole Brain Emulation, as a platform for creating safe AGI](https://reader035.vdocuments.us/reader035/viewer/2022062812/56816305550346895dd38296/html5/thumbnails/89.jpg)
business as usual
human extinction
stable totalitarianism
controlled intelligence explosion
uncontrolled intelligence explosion
WBEs