![Page 1: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/1.jpg)
Prof. Busch - LSU 1
Non-regular languages
(Pumping Lemma)
![Page 2: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/2.jpg)
Prof. Busch - LSU 2
Regular languages
ba* acb *
...etc
*)( bacb
Non-regular languages}0:{ nba nn
}*},{:{ bavvvR
![Page 3: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/3.jpg)
Prof. Busch - LSU 3
How can we prove that a languageis not regular?
L
Prove that there is no DFA or NFA or RE that accepts L
Difficulty: this is not easy to prove (since there is an infinite number of them)
Solution: use the Pumping Lemma !!!
![Page 4: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/4.jpg)
Prof. Busch - LSU 4
The Pigeonhole Principle
![Page 5: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/5.jpg)
Prof. Busch - LSU 5
pigeons
pigeonholes
4
3
![Page 6: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/6.jpg)
Prof. Busch - LSU 6
A pigeonhole mustcontain at least two pigeons
![Page 7: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/7.jpg)
Prof. Busch - LSU 7
...........
...........
pigeons
pigeonholes
n
m mn
![Page 8: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/8.jpg)
Prof. Busch - LSU 8
The Pigeonhole Principle
...........
pigeons
pigeonholes
n
m
mn There is a pigeonhole with at least 2 pigeons
![Page 9: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/9.jpg)
Prof. Busch - LSU 9
The Pigeonhole Principle
and
DFAs
![Page 10: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/10.jpg)
Prof. Busch - LSU 10
Consider a DFA with states 4
1q 2q 3qa
b
4q
b
a b
b
a a
![Page 11: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/11.jpg)
Prof. Busch - LSU 11
Consider the walk of a “long’’ string:
1q 2q 3qa
b
4q
b
b
b
a a
a
aaaab
1q 2q 3q 2q 3q 4qa a a a b
A state is repeated in the walk of
(length at least 4)
aaaab
![Page 12: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/12.jpg)
Prof. Busch - LSU 12
aaaab
1q 2q 3q 2q 3q 4qa a a a b
1q 2q 3q 4q
Pigeons:
Nests:(Automaton states)
Are more than
Walk of
The state is repeated as a result of the pigeonhole principle
(walk states)
Repeatedstate
Repeatedstate
![Page 13: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/13.jpg)
Prof. Busch - LSU 13
Consider the walk of a “long’’ string:
1q 2q 3qa
b
4q
b
b
b
a a
a
aabb
1q 2q 3q 4q 4qa a b b
A state is repeated in the walk of
(length at least 4)
Due to the pigeonhole principle:aabb
![Page 14: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/14.jpg)
Prof. Busch - LSU 14
aabb
1q 2q 3q 4qAutomaton States
Pigeons:
Nests:(Automaton states)
Are more than
Walk of
The state is repeated as a result of the pigeonhole principle:
(walk states)1q 2q 3q 4q 4qa a b b
Repeatedstate
![Page 15: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/15.jpg)
Prof. Busch - LSU 15
iq...... ......
Repeated state
kw 21
1 2 k
Walk of
iq.... iq.... ....1 2 ki j1i 1j
Arbitrary DFA
DFA of states#|| wIf ,by the pigeonhole principle,a state is repeated in the walk
In General:
1q zq
zq1q
w
![Page 16: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/16.jpg)
Prof. Busch - LSU 16
mDFA of states#|| w
1q 2q 1mq mq
Walk of wPigeons:
Nests:(Automaton states)
Are morethan
(walk states)
iq.... iq.... ....1q
iq.... ....
zq
A state is repeated
Number of states in walk is at least 1m
![Page 17: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/17.jpg)
Prof. Busch - LSU 17
The Pumping Lemma
![Page 18: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/18.jpg)
Prof. Busch - LSU 18
Take an infinite regular languageL
There exists a DFA that accepts L
mstates
(contains an infinite number of strings)
![Page 19: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/19.jpg)
Prof. Busch - LSU 19
mw ||(number of states of DFA)
then, at least one state is repeated in the walk of w
q...... ......1 2 k
Take string with Lw
kw 21Walk in DFA of
Repeated state in DFA
![Page 20: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/20.jpg)
Prof. Busch - LSU 20
Take to be the first state repeatedq
q....
w
There could be many states repeated
q.... ....
Second
occurrence
First
occurrence
Unique states
One dimensional projection of walk :
1 2 ki j1i 1j
![Page 21: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/21.jpg)
Prof. Busch - LSU 21
q.... q.... ....
Second
occurrence
First
occurrence 1 2 ki j
1i 1j
wOne dimensional projection of walk :
ix 1 jiy 1 kjz 1
xyzwWe can write
![Page 22: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/22.jpg)
Prof. Busch - LSU 22
zyxw
q... ...
x
y
z
In DFA:
...
...
1 ki1ij
1j
Where corresponds to substring between first and second occurrence ofq
y
![Page 23: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/23.jpg)
Prof. Busch - LSU 23
Observation: myx ||length numberof statesof DFA
Since, in no state is repeated (except q)
xy
unique states in
q...
x
y
...
1 i1ij
Because ofxy
![Page 24: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/24.jpg)
Prof. Busch - LSU 24
Observation: 1|| ylength
Since there is at least one transition in loop
q
y
...
1ij
![Page 25: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/25.jpg)
Prof. Busch - LSU 25
We do not care about the form of string z
q...
x
y
z
...
zmay actually overlap with the paths of and x y
![Page 26: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/26.jpg)
Prof. Busch - LSU 26
The string is accepted
zxAdditional string:
q... ...
x z
...
Do not follow loopy
...
1 ki1ij
1j
![Page 27: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/27.jpg)
Prof. Busch - LSU 27
The string is accepted
zyyx
q... ... ...
x z
Follow loop2 times
Additional string:
y
...
1 ki1ij
1j
![Page 28: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/28.jpg)
Prof. Busch - LSU 28
The string is accepted
zyyyx
q... ... ...
x z
Follow loop3 times
Additional string:
y
...
1 ki1ij
1j
![Page 29: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/29.jpg)
Prof. Busch - LSU 29
The string is accepted
zyx iIn General:
...,2,1,0i
q... ... ...
x z
Follow loop timesi
y
...
1 ki1ij
1j
![Page 30: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/30.jpg)
Prof. Busch - LSU 30
Lzyx i Therefore: ...,2,1,0i
Language accepted by the DFA
q... ... ...
x z
y
...
1 ki1ij
1j
![Page 31: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/31.jpg)
Prof. Busch - LSU 31
In other words, we described:
The Pumping Lemma !!!
![Page 32: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/32.jpg)
Prof. Busch - LSU 32
The Pumping Lemma:
• Given a infinite regular language L
• there exists an integer m
• for any string with length Lw mw ||
• we can write zyxw
• with andmyx || 1|| y
• such that: Lzyx i ...,2,1,0i
(critical length)
![Page 33: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/33.jpg)
Prof. Busch - LSU 33
In the book:
Critical length = Pumping lengthm p
![Page 34: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/34.jpg)
Prof. Busch - LSU 34
Applications
of
the Pumping Lemma
![Page 35: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/35.jpg)
Prof. Busch - LSU 35
Observation:Every language of finite size has to be regular
Therefore, every non-regular languagehas to be of infinite size (contains an infinite number of strings)
(we can easily construct an NFA that accepts every string in the language)
![Page 36: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/36.jpg)
Prof. Busch - LSU 36
Suppose you want to prove thatαn infinite language is not regular
1. Assume the opposite: is regular
2. The pumping lemma should hold for
3. Use the pumping lemma to obtain a contradiction
L
L
L
4. Therefore, is not regular L
![Page 37: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/37.jpg)
Prof. Busch - LSU 37
Explanation of Step 3: How to get a contradiction
2. Choose a particular string which satisfies the length condition
Lw
3. Write xyzw
4. Show that Lzxyw i for some 1i
5. This gives a contradiction, since from
pumping lemma Lzxyw i
mw ||
1. Let be the critical length for m L
![Page 38: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/38.jpg)
Prof. Busch - LSU 38
Note: It suffices to show that only one stringgives a contradiction
Lw
You don’t need to obtaincontradiction for every Lw
![Page 39: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/39.jpg)
Prof. Busch - LSU 39
Theorem:The language }0:{ nbaL nn
is not regular
Proof: Use the Pumping Lemma
Example of Pumping Lemma application
![Page 40: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/40.jpg)
Prof. Busch - LSU 40
Assume for contradictionthat is a regular languageL
Since is infinitewe can apply the Pumping Lemma
L
}0:{ nbaL nn
![Page 41: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/41.jpg)
Prof. Busch - LSU 41
Let be the critical length for
Pick a string such that: w Lw
mw ||and length
mmbawWe pick
m
}0:{ nbaL nn
L
![Page 42: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/42.jpg)
Prof. Busch - LSU 42
with lengths
From the Pumping Lemma:
1||,|| ymyx
babaaaaabaxyz mm ............
mkay k 1,
x y z
m m
we can write zyxbaw mm
Thus:
w
![Page 43: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/43.jpg)
Prof. Busch - LSU 43
From the Pumping Lemma: Lzyx i
...,2,1,0i
Thus:
mmbazyx
Lzyx 2
mkay k 1,
![Page 44: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/44.jpg)
Prof. Busch - LSU 44
From the Pumping Lemma:
Lbabaaaaaaazxy ...............2
x y z
km m
Thus:
Lzyx 2
mmbazyx
y
Lba mkm
mkay k 1,
![Page 45: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/45.jpg)
Prof. Busch - LSU 45
Lba mkm
}0:{ nbaL nnBUT:
Lba mkm
CONTRADICTION!!!
1≥k
![Page 46: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/46.jpg)
Prof. Busch - LSU 46
Our assumption thatis a regular language is not true
L
Conclusion: L is not a regular language
Therefore:
END OF PROOF
![Page 47: Prof. Busch - LSU1 Non-regular languages (Pumping Lemma)](https://reader036.vdocuments.us/reader036/viewer/2022062314/56649d755503460f94a560c7/html5/thumbnails/47.jpg)
Prof. Busch - LSU 47
Regular languages
Non-regular language }0:{ nba nn
)( **baL