1 gentle introduction to programming session 5: sorting, searching, time- complexity analysis,...
Post on 20-Dec-2015
214 views
TRANSCRIPT
1
Gentle Introduction to Programming
Session 5: Sorting, Searching, Time-Complexity Analysis, Memory Model,
Object Oriented Programming
2
Admin.
• Please come on time after the first break• Who goes to the Mathematics' summer introduction course?
3
Review
• Recursive vs. Iterative• Guest lecture: Prof. Benny Chor • Arrays
• Arrays in memory• Initialization and usage• foreach, filter • Arrays as functions arguments• Multi-dimensional arrays• References to array
• Sorting, searching• Binary search
4
Today• Home work review• Sorting, searching and time-complexity analysis
• Binary search• Bubble sort, Merge sort
• Scala memory model• Object-oriented programming (OOP)
• Classes and Objects• Functional Objects (Rational Numbers example)
• Home work
Decimal Binary
• We want to print the binary representation of a decimal number
• Examples:• 0 -> 0• 8 -> 1000• 12 -> 1100• 31 -> 11111
Decimal Binary Recursively
• The conversion of a number d from decimal to binary:• If d is 0 or 1 – write d to the left and stop, else:• If d is even, write ‘0’ to the left• If d is odd, write ‘1’ to the left• Repeat recursively with floor(d/2)
Example: d = 14
d Output at the end of stage Action at the end of stage
14 0 Insert 0 to left of output; divide d by 2
7 10 Insert 1 to left of output; divide d by 2 and round down
3 110 Insert 1 to left of output; divide d by 2 and round down
1 1110 Insert 1 to left of output; return.
Solution Dec2Bin.scala
9
Exercise 1
Write a program that gets 10 numbers from the user.It then accepts another number and checks to see ifthat number was one of the previous ones.
Example 1:Please enter 10 numbers:1 2 3 4 5 6 7 8 9 10Please enter a number to search for: 8Found it!
Example 2:Please enter 10 numbers:1 2 3 4 5 6 7 8 9 10Please enter a number to search for: 30Sorry, it’s not there
10
Solution FindNumber.scala
11
Exercise 2
• Implement a function that accepts two integer arrays and returns true if they are equal, false otherwise. The arrays are of the same size
• Write a program that accepts two arrays of integers from the user and checks for equality
12
SolutionCompareArrays.scala
13
Solution (main)CompareArrays.scala
14
Today• Home work review• Sorting, searching and time-complexity analysis
• Binary search• Bubble sort, Merge sort
• Scala memory model• Object-oriented programming (OOP)
• Classes and Objects• Functional Objects (Rational Numbers example)
• Home work
15
Sort
• We would like to sort the elements in an array in an ascending order
7 2 8 5 4 2 4 5 7 8sort
16
What is Sorting Good For?
• Finding a number in an array• Consider a large array (of length n) and
multiple queries on whether a given number exists in the array (and what is its position in it)
• Naive solution: given a number, traverse the array and search for it• Not efficient ~ n/2 steps for each search operation
• Can we do better?• Sort the array as a preliminary step. Now search can
be performed much faster!
17
Binary Search• Input:
• A sorted array of integers A
• An integer query q
• Output:• -1 if q is not a member of A
• The index of q in A otherwise
• Algorithm:• Check the middle element of A
• If it is equal to q, return its index
• If it is >= q, search for q in A[0,…,middle-1]
• If it is < q, search for q in A[middle+1,...,end]
18
Example
0 1 2 3 4 5 6 7 8 9-5 -3 0 4 8 11 22 56 57 97
index
value
http://www.youtube.com/watch?v=ZrN6J8No080
19
Code – Binary Search
20
Code – Usage
21
So, How Fast is it?• Worst case analysis
• Size of the inspected array:
n n/2 n/4 ….. 1
• Each step is very fast (a small constant number of operations)
• There are log2(n) such steps
• So it takes ~ log2(n) steps per search
• Much faster then ~ n
22
Bubble Sort
23
Bubble Sort Example
7 2 8 5 4
2 7 8 5 4
2 7 8 5 4
2 7 5 8 4
2 7 5 4 8
2 7 5 4 8
2 5 7 4 8
2 5 4 7 8
2 7 5 4 8
2 5 4 7 8
2 4 5 7 8
2 5 4 7 8
2 4 5 7 8
2 4 5 7 8
(done)
24
Another Example
http://www.youtube.com/watch?v=myKlT30nl5Y
25
Bubble Sort
26
Orders of Growth
• Suppose n is a parameter that measures the size of a problem (the size of its input)
• R(n) measures the amount of resources needed to compute a solution procedure of size n
• Two common resources are space, measured by the number of deferred operations, and time, measured by the number of primitive steps
The worst-case over all inputs of size n!
27
Orders of Growth
• Want to estimate the “order of growth” of R(n):
R1(n)=100n2
R2(n)=2n2+10n+2
R3(n) = n2Are all the same in the sense that if we multiply the input by a factor of 2, the resource consumption increases by a factor of 4
Order of growth is proportional to n2
28
Summary
• Trying to capture the nature of processes
• Quantify various properties of processes:• Number of steps a process takes (Time Complexity)• Amount of Space a process uses (Space Complexity)
• You will encounter these issues in many courses throughout your studies
• We shall focus on the (intuitive) time complexity analysis of various sorting algorithms
29
Examples
• Find a maximum in a general array
• Find the maximum in a sorted array
• Find the 5th largest element in a sorted array
• Answer n Fibonacci quarries, each limited by MAX
• Find an element in a general array
• Find an element in a sorted array
30
Bubble Sort Time ComplexityArray of size n
n iterationsi iterations
constant
(n-1 + n-2 + n-3 + …. + 1) * const ~ ½ * n2
31
The Idea Behind Marge Sort• A small list will take fewer steps to sort than
a large list
• Fewer steps are required to construct a sorted list from two sorted lists than two unsorted lists
32
Marge Sort Algorithm• If the array is of length 0 or 1, then it is
already sorted. Otherwise:
• Divide the unsorted array into two sub-arrays of about half the size
• Sort each sub-array recursively by re-applying merge sort
• Merge the two sub-arrays back into one sorted array
33
Merge Sort Example
http://en.wikipedia.org/wiki/Merge_sort
34
Marge Sort Time Complexity• If the array is of length 0 or 1, then it is already sorted. Otherwise:
• Divide the unsorted array into two sub-arrays of about half the size
• Sort each sub-array recursively by re-applying merge sort
• Merge the two sub-arrays back into one sorted array
n + 2 * (n/2) + 22 * n/22 + 23 * n/23 + … + 2log(n) * n/2log(n) =
n + n + … + n = n * log(n)
log(n)
35
Today• Home work review• Sorting, searching and time-complexity analysis
• Binary search• Bubble sort, Merge sort
• Scala memory model• Object-oriented programming (OOP)
• Classes and Objects• Functional Objects (Rational Numbers example)
• Home work
36
Passing Arguments to Functions
• When a function is called, arguments’ values are attached to function’s formal parameters by order, and an assignment occurs before execution
• Values are copied to formal parameters
• “Call by value”
• Function’s parameters are defined as vals
37
Passing Arguments to Functions
• A reference is also passed by value• Example: arrays• Objects (?)• This explains why we can change an array’s
content within a function
4 5 6 7 8 9a
38
Local Names
• Arguments names do not matter!
• Local variable name hides in-scope variables with the same name
Different x!
39
Everything is an Object (in Scala)
• In Java: primitives vs. objects• In Scala everything is an Object• But: special treatment for primitives• Why do we care?
val x = 5
var y = x
y = 6
val ar1 = Array(1,2,3)
val ar2 = ar1
ar2(0) = 4?
40
?
val x = 5
var y = x
y = 6
val ar1 = Array(1,2,3)
val ar2 = ar1
ar2(0) = 4
41
Memory Image 1
val x = 5
var y = x
y = 6
x 5
y 5y
6
42
Memory Image 2
val ar1 = Array(1,2,3)
val ar2 = ar1
ar2(0) = 4
ar1 1 2 3
ar2
4
43
Scala Memory Model
• Based on Java…• Stack: local variables and arguments, every
function uses a certain part of the stack• Stack variables “disappear” when scope ends
• Heap: global variables and object, scope independent• Garbage Collector
• Partial description
44
How to Change a Variable via Functions?
• The arguments are passed as vals thus can not be changed
• So how can a method change an outer variable?• By its return value• By accessing heap-based memory (e.g., arrays)
45
Today• Home work review• Sorting, searching and time-complexity analysis
• Binary search• Bubble sort, Merge sort
• Scala memory model• Object-oriented programming (OOP)
• Classes and Objects• Functional Objects (Rational Numbers example)
• Home work
46
Programming in Scala
Chapter 4: Classes and Objects Chapter 6: Functional Objects
47
Singletone Objects
• All programs written so far in this course are Signletone objects
• File start with the reserved word object
• Contain functions that can be used elsewhere
• Application: singeltone object with a main function
• (Actually singeltone objects are more then that)• (Java programmers: think of it as a holder of static
methods)
48
A Car
• How would you represent a car?• Parts / features: 4 wheels, steering wheel, horn,
color,…• Functionality: drive, turn left, honk, repaint,…
• In Scala???
49
Object-Oriented Programming (OOP)
• Represent problem-domain entities using a computer language
• When building a software in a specific domain, describe the different components of the domain as types and variables
• Thus we can take another step up in abstraction
50
Class as a BlueprintA class is a blueprint of objects
51
Class as a BlueprintA class is a blueprint of objects
52
Classes as Data Types
• Classes define types that are a composition of other types and have unique functionality
• An instance of a class is named an object• Every instance may contain:
• Data members / fields• Methods• Constructors
• Instances are accessed only through reference
53
Examples
• String• Members: all private• Methods: length, replace, startsWith, substring,…• Constructors: String(), String(String),…• http://java.sun.com/j2se/1.5.0/docs/api/java/lang/String.html
• Array• Members: all private• Methods: length, filter, update,…• Constructors: initiate with 1-9 dimensions• http://www.scala-lang.org/docu/files/api/scala/Array.html
54
Car Example
• Members: 4 wheels, steering wheel, horn, color,…
• Every car instance has its own
• Methods: drive, turn left, honk, repaint,…
• Constructors: Car(String color), Car(Array[Wheels], Engine,…), …
55
Today• Home work review• Sorting, searching and time-complexity analysis
• Binary search• Bubble sort, Merge sort
• Scala memory model• Object-oriented programming (OOP)
• Classes and Objects• Functional Objects (Rational Numbers example)
• Home work
56
Rational Numbers
• A rational number is a number that can be expressed as a ration n/d (n,d integers, d not 0)
• Examples: 1/2, 2/3, 112/239, 2/1
• Not an approximation
57
Specification• Add, subtract, multiply, divide
• println should work smoothly• Immutable (result of an operation is a new rational number)
• It should feel like native language support
58
Constructing a Rational
• How client programmer will create a new Rational object?
Class parameters
59
Constructing a Rational• The Scala compiler will compile any code placed in
the class body, which isn’t part of a field or a method definition, into the primary constructor
?
60
Reimplementing toString
• toString method• A more useful implementation of toString would
print out the values of the Rational’s numerator and denominator
• override the default implementation
61
Usage
• Now we can remove the debug println…
62
Checking Preconditions
• Ensure the data is valid when the object is constructed
• Use require
63
Define “add” Method
• Immutable• Define add:
64
Add Fields• n, d are in scope in the add method• Access then only on the object on which add
was invoked
65
Test Add, Access Fields
66
Self Reference (this)
• Define method lessThan:
• Define method max:
67
Auxiliary Constructors• Constructors other then the primary
• Example: a rational number with a denominator of 1 (e.g., 5/1 5)
• We would like to do: new Rational(5)• Auxiliary constructor first action: invoke
another constructor of the same class
• The primary constructor is thus the single point of entry of a class
68
Revised Rational
69
Private Fields and Methods
• 66/42 = 11/7• To normalize divide the numerator and
denominator by their greatest common divisor (gcd)• gcd(66,42) = 6 (66/6)/(42/6) = 11/7• No need for Rational clients to be aware of this• Encapsulation
70
Off Topic: Calculate gcd• gcd(a,b) = g
• a = n * g• b = m * g• gcd(n,m)=1(otherwise g is not the gcd)• a = t * b + r = t * m * g + r g is a divisor of r
• gcd(a,b) = gcd(b,a%b)• The Euclidean algorithm: repeat iteratively:
if (b == 0) return aelse repeat using a b, b a%b
• http://en.wikipedia.org/wiki/Euclidean_algorithm
71
Correctness• Example:
gcd(40,24) gcd(24,16) gcd(16,8) gcd(8,0) 8
• Prove: g = gcd(a,b) = gcd(b,a%b)= g1• g1 is a divisor of a ( g1 ≤ g)• There is no larger divisor of a ( g1 ≥ g)
• ≤ : a = t * b + r a = t * h * g1 + v * g1 g1 is a divisor of a
• ≥ : assume g > g1 a = t * b + r g is a divisor of b and r contradiction
72
Implementation
73
Revised Rational
74
Defining Operators• Why not use natural arithmetic operators?
• Replace add by the usual mathematical symbol
• Operator precedence will be kept
• All operations are method calls
75
Revised Rational
76
Usage
77
Method Overloading• Now we can add and multiply rational numbers!• What about mixed arithmetic?
• r * 2 won’t work • r * new Rational(2) is not nice
• Add new methods for mixed addition and multiplication
• Method overloading• The compiler picks the correct overloaded
method
78
Usage
• The * method invoked is determined in each case by the type of the right operand
79
Revised Rational
80
Implicit Conversions
• 2 * r 2.*(r) method call on 2 (Int) Int class contains no multiplication method that takes a Rational argument
• Create an implicit conversion that automatically converts integers to rational numbers when needed
81
Companion Object
82
Revised Rational
• Define implicit conversion in Rational.scala, after defining object Rational
83
In Eclipse
• In Rational.scala:• Companion object
(object Rational)• Rational class (class
Rational)
• Place the main method in another file
84
Summary• Customize classes so that they are natural
to use• fields, methods, primary constructor• Method overriding• Self reference (this)• Define several constructors• Encapsulation• Define operators as method• Method overloading• Implicit conversions, companion object
85
Today• Home work review• Sorting, searching and time-complexity analysis
• Binary search• Bubble sort, Merge sort
• Scala memory model• Object-oriented programming (OOP)
• Classes and Objects• Functional Objects (Rational Numbers example)
• Home work
86
Exercise 1
• Read, understand and implement selection/insertion sort algorithm• http://en.wikipedia.org/wiki/Selection_sort• http://en.wikipedia.org/wiki/Insertion_sort
87
Exercise 2• Implement class Complex so it is natural to use
complex numbers• Examples:
88
Want More Exercises?
89
Exercise (tough!)
• Read, understand and implement quick sort algorithm• http://en.wikipedia.org/wiki/Quicksort