ae1aps algorithmic problem solving john drake. invariants – chapter 2 river crossing – chapter...

Tower of Hanoi

AE1APS Algorithmic Problem SolvingJohn Drake

Invariants – Chapter 2 River Crossing – Chapter 3 Logic Puzzles – Chapter 5 Matchstick Games - Chapter 4

◦ Sum Games – Chapter 4 Induction – Chapter 6

◦ Tower of Hanoi – Chapter 8

Outline of the course

Breaking larger problems down into sub-problems

Using small instances of a problem to help us solve larger instances

Find a trivial base case where size = 0

Show for an arbitrary number n how to solve n + 1 (induction step)

A recap on induction

This problem is discussed in many maths texts, and is used in computer science and AI as an illustration of recursion and problem solving

You probably know the problem, but we will look at it slightly differently

Induction gives a systematic way of finding a solution

However this solution is undesirable A better solution is obtained by observing the

invariants of the inductive solution

Tower of Hanoi - Introduction

We will start at the end We begin with the solution (as you probably

already know it) and you can see where we are going

Another reason is to understand why a correct solution has been found, if no information about the solution method is provided

Begin with the solution

There is a temple in Bramah, where there are 3 giant poles fixed in the ground.

On the first pole, God placed 64 discs, each of different size in decreasing order of size

The Brahmin monks were given the task of moving the discs, one per day, from one pole to another

However, no disc must be above a smaller disc, when on the same pole

 Problem specification

Tower of Hanoi

Almost every book (and webpage) I have seen draws the 3 poles in a line

We can call the poles A, B, C

However there is a simple symmetry which is being ignored here

Triangle representation

We draw them in different positions A better way is to draw and equilateral

triangle, and the symmetry is obvious. Now the moves of the discs can easily be

described as clockwise or anti-clockwise.

Triangle representation

There is a very easy solution to the Towers of Hanoi problem

It is easy to remember and execute We assume the problem is to move the

discs from one pole to the next in the clockwise direction

The days are numbered from 0, 1, 2… On day 0, the discs are placed in their initial

position, and the monks begin moving the discs on day 1.

Iterative solution (assumptions)

On every alternate day, the smallest disk is moved

The smallest disc should cycle around the poles.

The direction of rotation depends on the number of discs

It the total number is odd, it cycles clockwise, otherwise if the total is even, it cycles anticlockwise

Iterative solution 1

On every other day, another disc is moved (other than the smallest disc)

As no disc can be on a smaller disc, there is only one possible move for the disc

The algorithm terminates when no further moves are possible

That is, on a even numbered day when all the discs are on the same pole 

Iterative solution 2

Day 0

Iterative solution – 4 discs

Day 1

Iterative solution – 4 discs

Day 2

Iterative solution – 4 discs

Day 3

Iterative solution – 4 discs

Day 4

Iterative solution – 4 discs

Day 5

Iterative solution – 4 discs

Day 6

Iterative solution – 4 discs

Day 7

Iterative solution – 4 discs

Day 8

Iterative solution – 4 discs

Day 9

Iterative solution – 4 discs

Day 10

Iterative solution – 4 discs

Day 11

Iterative solution – 4 discs

Day 12

Iterative solution – 4 discs

Day 13

Iterative solution – 4 discs

Day 14

Iterative solution – 4 discs

Day 15

Iterative solution – 4 discs

Presenting the solution like this, provides us with no help in understanding how the solution was constructed

How would we give a formal mathematical verification of the correctness of the algorithm

By observing a number of invariants, we show how to derive the algorithm from the inductive solution.

Why?

Suppose the task is to move M discs from one pole to another specific pole.

Base case. When there are 0 discs, no steps are needed to complete the task

For the inductive step, we assume we can move n discs from A to B, and the problem is to show how to move n+1 discs from A to B

We get stuck with this approach

Inductive solution

First move n top discs from A to B

After doing this, all the discs are on B

We have no hypothesis about moving discs from this pole

i.e. The information that we can move n discs from A to B does not help us in trying to move n+1 from A to B

Stuck

Example with n = 3

A B C

Example with n = 3

A B C

Alternatively, we can move the smallest from pole A to pole C

We then move n discs from A to B

Once again we have exhausted all possibilities of using the inductive hypothesis

Because the n discs are on pole B and we have no hypothesis about moving discs from this pole.

Still stuck

We have been too specific about the inductive hypothesis

The way out of this is to introduce some parameters which model the start and final positions of the discs

Too Specific

We make a crucial decision

Rather than name the poles A B C, we observe that the problem exhibits a rotational symmetry

This is obvious when the poles are arranged in a triangle, but obscured when the poles are placed in a line.

Rotational symmetry

One additional parameter needs to be introduced, the direction of movement

We only need to say if a particular disc needs to be moved in a clockwise or anti- clockwise direction

The generalisation of the problem becomes, how to move n discs from one pole to the next in the direction d◦ (where d is either clockwise or anti-clockwise)

An additional parameter

The inductive hypothesis we use is that it is possible to move the n smallest discs from one pole to another in direction d beginning from any valid starting point

That is, a starting position in which the discs are distributed arbitrarily over the poles, but no disc is on top of a disc smaller than itself

This is a far more general definition

Inductive hypothesis

For n = 0, the sequence of moves is empty. In the case of n+1 discs, we assume we

have a method of moving the n smallest discs from one pole to one of the other two poles.

We must show how to move n+1 discs from one pole to another pole in direction d, where d is either clockwise or anticlockwise.

Assume the discs are numbered 1 upwards (with the smallest disc numbered 1)

Base and inductive case

There is little choice in exploiting the inductive hypothesis we can begin by moving the n smallest discs in the direction d, or direction ¬d.

The solution is to move the n discs in direction ¬d, then the n+1th disc can be moved in direction d

We can then use the inductive hypothesis again to move the n smallest discs in the direction ¬d.

This places the n discs above the n+1th disc, and all of the n+1 smallest discs have now been moved from their original position to a new pole in direction d

Using the inductive hypothesis

Example with n = 3

Example with n = 3

Example with n = 3

Example with n = 3

We can use the previous solution to get a solution for n+1 using the inductive step

For n+1 (i.e. 3+1 = 4)

Example with n = 4

Example with n = 4

Example with n = 4

Example with n = 4

The following code summarises the inductive solution to the problem

Hn(d) is the sequence of pairs <k,d’> where n in the number of discs, k is a disc number and d and d’ are directions

Directions are Boolean values, true representing clockwise, and false representing anti-clockwise

The pair <k, d’> means, move disc number k from its current position in the direction d’

The pair is therefore an action. We use the ; to separate movements.

Psuedocode

Hn(d) means the sequence to move the n smallest discs in direction d

Taking the pairs in order from left to right, the complete sequence Hn(d) prescribes how to move the n smallest discs, one by one, from one pole to another in direction d

Hn(d)

Hn(d)

H0(d) = []

– base case (i.e. 0 moves needed)

Hn+1(d) = Hn(¬d) ; [<n+1, d>] ; Hn(¬d)

– induction step (move n discs in a given direction, move the n+1th disc in the opposite direction then move n discs again in the same direction)

Psuedocode

Notice that the procedure name, H, occurs on both sides of the equation for Hn+1(d)◦ Hn+1(d) = Hn(¬d) ; [<n+1, d>] ; Hn(¬d)

For this reason we call this a recursive solution (i.e. the procedure calls itself, think of Java)

Psuedocode

This inductive procedure gives us a way to generate the solution to the problem for any size n

We simply use the rules as rewrite rules, until all occurrences of H have been eliminated◦ i.e. we are left with just a sequence of actions

(e.g. move disc 3 clockwise)

How to use

Let us use cw and aw to mean clockwise and anti-clockwise, rather than true and false to improve readability

Calculate H2(cw) i.e. how to move 2 discs, one pole in a clockwise direction

Equation (1)◦ H0(d) = []

Equation (2)◦ Hn+1(d) = Hn(¬d) ; [<n+1, d>] ; Hn(¬d)

H2(cw)

<1,aw>

Example with n = 2

<2,cw>

Example with n = 2

<1,aw>

Example with n = 2

Example with n = 2

Exercise – Can you do H3(aw)?

Can you see a pattern in the number of moves required for n discs? i.e. H0, H1, H2, H3…

Show this as a formula in terms of n?

If this is easy, try exercise 8.3 a) (without cheating and looking at the answer first)

H3(cw)?