dr. sven j. körner [email protected] @svenjkoerner€¦ · alice: balls have zero to me to...

55
Dr. Sven J. Körner [email protected] @svenjkoerner

Upload: others

Post on 30-Jul-2020

3 views

Category:

Documents


0 download

TRANSCRIPT

Page 1: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Dr. Sven J. Körner

[email protected]@svenjkoerner

Page 2: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

“We humans have a love-hate relationship with our technology. We

love each new advance and we hate how fast our world is changing.”

— Daniel H. Wilson

Page 3: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

NO!

Page 4: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

We Used the Last ParadigmShift For Good

Page 5: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

But We Run The Risk of Becoming the Largest Living Museum of

20th Century Tech.

Page 6: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

We’re Missing Out on 21st Century Tech.

Page 7: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Overestimating the Short Term Impact.

Underestimating the Long Term Impact.

Page 8: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

AI Isn’t Taking Over

Others Are Overtaking Us With AI.

Page 9: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

The First Rule of AI:

Hard Problems Are Easy.

Easy Problems Are Hard.

Page 10: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Substituierbarkeitspotentiale Deutschlandnach Branchen

Quelle: FAZ http://www.faz.net/-gym-9f0y3 / Beschäftigungsstatistik der Bundesagentur für Arbeit, Stand 31.12.2016

Anteil der Beschäftigten mit hohem Substituierbarkeitspotenzial (>70%) an allen Beschäftigten.

Page 11: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 12: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 13: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 14: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 15: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 16: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 17: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Software Engineering vs. AI (SE 2.0)

Problem Code Solution

Problem Solution Code

Page 18: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Context and Proper Training Matter

but use it here...If you train a system on these...

Page 19: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Drawbacks of NN – (Wrong) Training contd

Page 20: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 21: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

“People remember errorscommitted by AI, but forget human errors”

Page 22: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 23: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 24: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 25: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

am am pmpm

ampm

ampm

inout

Input Layer

Output Layer

day shift night shift

Page 26: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

am am pmpm

ampm

ampm

1 1 110 0 0 0

inout

Input Layer

Output Layer

day shift night shift

Page 27: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

am am pmpm

ampm

ampm

.3 .2 .1.9.8 .9 .6 .4

inout

Input Layer

Output Layer

Page 28: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

am pm

ampm

ampm

.3 .2 .1.9.8 .9 .6 .4

(.3+.1)/2 = .2 (.8+.4)/2 = .6

inout

ampm

ampm

Input Layer

Output Layer

Page 29: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

am pm

ampm

ampm

.3 .2 .1.9.8 .9 .6 .4

(.3+.1)/2 = .2 (.8+.4)/2 = .6

Gradient Descent

inout

Input Layer

Output Layer

Page 30: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

am pm

.3 .1 .1.6.9 .9 .6 .5

(.3+.1)/2 = .2 (.9+.5)/2 = .7

Gradient Descent

inout

Input Layer

Output Layer

ampm

ampm

Page 31: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

How Computers and Brains Are Different

Page 32: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

How Computers and Brains Are Differentcont‘d

Page 33: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

How Computers and Brains Are DifferentPart III

Page 34: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

“We found that this information bottleneck measure doesn’t see compression in the same way you or I would. Given the choice, it is just

as happy to lump 'martini glasses' in with ‘Labradors', as it is to lump them in with

'champagne flutes”

Brendan Tracey (SFI, MIT)

Page 35: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Words exist because of meaning. Once you've gotten the meaning, you can forget the words.”

Zhuangzi

Common Sense.

For Computers.

Page 36: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

What Are Semantics?

Page 37: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Identifying an adult female from other persons might be a data-centric problem

But finding the teacher and the mother requires information not in the data.

adult_female 0.943

adult_female 0.854

mother

teacher

Page 38: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Facebook Bots Invented Their Own Language

Bob: i can i i everything else . . . . . . . . . . . . . .

Alice: balls have zero to me to me to me to me to me to me to me to me to

Bob: you i everything else . . . . . . . . . . . . . .

Alice: balls have a ball to me to me to me to me to me to me to me

Bob: i i can i i i everything else . . . . . . . . . . . . . .

Alice: balls have a ball to me to me to me to me to me to me to me

Bob: i . . . . . . . . . . . . . . . . . . .

Alice: balls have zero to me to me to me to me to me to me to me to me to

Bob: you i i i i i everything else . . . . . . . . . . . . . .

Alice: balls have 0 to me to me to me to me to me to me to me to me to

Bob: you i i i everything else . . . . . . . . . . . . . .

Alice: balls have zero to me to me to me to me to me to me to me to me to

Page 39: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

OpenAI GPT-2

Page 40: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Recycling is good for the world, no, you could not be more wrong.

Page 41: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Recycling is NOT good for the world.It is bad for the environment, it is bad for our health,

and it is bad for our economy. I’m not kidding. Recycling is not good for the environment.

It is destructive to the earth and it is a major contributor to global warming. Recycling is bad for our economy.

It increases the cost of a product, and in turn, the price of everything that is made with that product.

Recycling is not good for our nation. We pay a tremendous price for the privilege of having the world’s most

advanced and efficient recycling system. Recycling is a huge, colossal waste of time, energy, money, and resources.

Page 42: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Replacing

DrudgeWork

Page 43: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Human Ability To Learn

Amount of Information

Computer Thinking Speed

Page 44: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

???

Page 45: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the
Page 46: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

1st : Automate Expensive Tasks

Page 47: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

2nd: Not Just Faster – But More

Your Job

Page 48: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Hertz Car Rental Example

Page 49: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

<Type of Clause, Standard, or Paragraph>GDPR Regulation No. 1

<Type of Clause, Standard, or Paragraph>GDPR Regulation No. 2

<Type of Clause, Standard, or Paragraph> Procurement Clause No. 4711

<Type of Clause, Standard, or Paragraph>GDPR Regulation No. 3

<Type of Clause, Standard, or Paragraph>GDPR Regulation No. 5

<Type of Clause, Standard, or Paragraph>NDA Regulation No. 13

<Type of Clause, Standard, or Paragraph>GDPR Regulation No. 4

<Type of Clause, Standard, or Paragraph>NDA Regulation No. 2

<Type of Clause, Standard, or Paragraph>GDPR Regulation No. 6

<Type of Clause, Standard, or Paragraph>Procurement Clause A14

<Type of Clause, Standard, or Paragraph>Export Restrictions Clause

Topics:

• Reference to internal standard of paragraphs/chapters/clauses

• Mapping from clauses to paragraph(s)/chapter(s) in other contracts

• Clause correction and detection• Auto-tagging of contracts• Extract values for further (automated)

processing

Green => Matching OKYellow => Values extractionOrange => Multiple matchesRed => No Gos

AI Lawyer I: Helping to Find Relevant Contract Data and Map

to Existing Clauses, Standards, and Contracts

Semantic Similarity Service

Page 50: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Box.com (Document Management)

Page 51: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Sharepoint (Semantic Compare)

Page 52: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

Semantic Clustering (Matrix)

Page 53: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

If only 10% are replaced by machines – what would that mean to society?

More than 10% of money for states get lost.Machines don’t pay taxes.Machines don’t consume.

Page 54: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

The First Rule of AI:

Hard Problems Are Easy.

Easy Problems Are Hard.

Page 55: Dr. Sven J. Körner sven@thingsTHINKING.net @svenjkoerner€¦ · Alice: balls have zero to me to me to me to me to me to me to me to me to. OpenAI GPT-2. Recycling is good for the

[email protected]@svenjkoerner