![Page 1: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/1.jpg)
ENGG2013 Unit 15
Rank, determinant, dimension,and the links between them
Mar, 2011.
![Page 2: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/2.jpg)
Review on “rank”
• “row-rank of a matrix” counts the max. number of linearly independent rows.
• “column-rank of a matrix” counts the max. number of linearly independent columns.
• One application: Given a large system of linear equations, count the number of essentially different equations.– The number of essentially different equations is
just the row-rank of the augmented matrix.kshum ENGG2013 2
![Page 3: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/3.jpg)
Evaluating the row-rank by definition
kshum ENGG2013 3
Linearly independent
Linearly independent
Linearly independent
Linearly independent
Linearly independent
Linearly dependent
Linearly dependent Row-Rank = 2
![Page 4: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/4.jpg)
Calculation of row-rank via RREF
kshum ENGG2013 4
Row reductions
Row-rank = 2Row-rank = 2
Because row reductionsdo not affect the numberof linearly independent rows
![Page 5: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/5.jpg)
Calculation of column-rank by definition
kshum ENGG2013 5
List all combinationsof columns
Linearly independent??
Y Y Y Y Y Y Y Y Y
N N
Y
N N
N
Column-Rank = 2
![Page 6: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/6.jpg)
Theorem
Given any matrix, its row-rank and column-rank are equal.
In view of this property, we can just say the “rank of a matrix”. It means either the row-rank of column-rank.
kshum ENGG2013 6
![Page 7: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/7.jpg)
Why row-rank = column-rank?
• If some column vectors are linearly dependent, they remain linearly dependent after any elementary row operation
• For example, are linearly dependent
kshum ENGG2013 7
![Page 8: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/8.jpg)
Why row-rank = column-rank?
• Any row operation does not change the column- rank.
• By the same argument, apply to the transpose of the matrix, we conclude that any column operation does not change the row-rank as well.
kshum ENGG2013 8
![Page 9: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/9.jpg)
Why row-rank = column-rank?
kshum ENGG2013 9
Apply row reductions.row-rank and column-rankdo not change.
Apply column reductions.row-rank and column-rankdo not change.
The top-left corner isan identity matrix.
The row-rank and column-rank of this “normal form” is certainlythe size of this identity submatrix,and are therefore equal.
![Page 10: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/10.jpg)
DISCRIMINANT, DETERMINANT AND RANK
kshum ENGG2013 10
![Page 11: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/11.jpg)
Discriminant of a quadratic equation
• y = ax2+bx+c• Discirminant of ax2+bx+c = b2-4ac.• It determines whether the roots are distinct or not
kshum ENGG2013 11
x
y
![Page 12: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/12.jpg)
Discriminant measures the separation of roots
• y = x2+bx+c. Let the roots be and . • y = (x – )(x – ). Discriminant = ( – )2.• Discriminant is zero means that the two roots coincide.
kshum ENGG2013 12
x
y
( – )2
![Page 13: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/13.jpg)
Discriminant is invariant under translation
• If we substitute u= x – t into y = ax2+bx+c, (t is any real constant), then the discriminant of a(u+t)2+b(u+t)+c, as a polynomial in u, is the same as before.
kshum ENGG2013 13
u
y
( – )2
![Page 14: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/14.jpg)
Determinant of a square matrix• The determinant of a square matrix determine whether the matrix is invertible or not.
– Zero determinant: not invertible– Non-zero determinant: invertible.
kshum ENGG2013 14
![Page 15: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/15.jpg)
Determinant measure the area
• 22 determinant measures the area of a parallelogram.
• 33 determinant measures the volume of a parallelopiped.
• nn determinant measures the “volume” of some “parallelogram” in n-dimension.
• Determinant is zero means that the columns vectors lie in some lower-dimensional space.
kshum ENGG2013 15
![Page 16: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/16.jpg)
Determinant is invariant under shearing action
• Shearing action = third kind of elementary row or column operation
kshum ENGG2013 16
![Page 17: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/17.jpg)
Rank of a rectangular matrix
• The rank of a matrix counts the maximal number of linearly independent rows.
• It also counts the maximal number of linearly independent columns.
• It is an integer.• If the matrix is mn, then the rank is an
integer between 0 and min(m,n).
kshum ENGG2013 17
![Page 18: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/18.jpg)
Rank is invariant under row and column operations
kshum ENGG2013 18
Rank = 2
Rank = 2
Rank = 2
Rank = 2
Rank = 2Rank = 2Rank = 2
![Page 19: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/19.jpg)
Comparison between det and rank
Determinant• Real number• Defined to square matrix only• Non-zero det implies existence
of inverse.• When det is zero, we only
know that all the columns (or rows) together are linearly dependent, but don’t know any information about subset of columns (or rows) which are linearly independent.
Rank• Integer• Defined to any rectangular
matrix• When applied to nn
square matrix, rank=n implies existence of inverse.
kshum ENGG2013 19
![Page 20: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/20.jpg)
Basis: Definition
• For any given vector in
if there is one and only one choice for the coefficients c1, c2, …,ck, such that
we say that these k vectors form a basis of . kshum ENGG2013 20
![Page 21: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/21.jpg)
Yet another interpretation of rank
• Recall that a subspace W in is a subset which is– Closed under addition: Sum of any two vectors in
W stay in W.– Closed under scalar multiplication: scalar multiple
of any vector in W stays in W as well.
kshum ENGG2013 21
W
![Page 22: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/22.jpg)
Closedness property of subspace
kshum ENGG2013 22
W
![Page 23: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/23.jpg)
Geometric picture
kshum ENGG2013 23
x
y
zW
W is the planegenerated, or spanned,by these vectors.
x – 3y + z = 0
![Page 24: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/24.jpg)
Basis and dimension
• A basis of a subspace W is a set of linearly independent vectors which span W.
• A rigorous definition of the dimension is:
Dim(W) = the number of vectors in a basis of W.
kshum ENGG2013 24
x
yz
W
![Page 25: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/25.jpg)
Rank as dimension
• In this context, the rank of a matrix is the dimension of the subspace spanned by the rows of this matrix.– The least number of row vectors required to span
the subspace spanned by the rows.
• The rank is also the dimension of the subspace spanned by the column of this matrix.– The least number of column vectors required to
span the subspace spanned by the columns
kshum ENGG2013 25
![Page 26: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/26.jpg)
Example
kshum ENGG2013 26
x
y
z
The three row vectorslie on the same plane.
Two of them is enoughto describe the plane.
x – 2y + z = 0
Rank = 2
![Page 27: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/27.jpg)
INTERPOLATION
kshum ENGG2013 27
![Page 28: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/28.jpg)
Polynomial interpolation• Given n points, find a polynomial of degree n-1 which goes through
these n points.• Technical requirements:
– All x-coordinates must be distinct– y-coordinates need not be distinct.
kshum ENGG2013 28
x1 x2 x3 x4
y1
y2y3
y4
![Page 29: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/29.jpg)
Lagrange interpolation
• Lagrange interpolating polynomial for four data points:
kshum ENGG2013 29
![Page 30: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/30.jpg)
Computing the coefficients by linear equations
• We want to solve for coefficients c3, c2, c1, and c0, such that
or equivalently
kshum ENGG2013 30
![Page 31: ENGG2013 Unit 15 Rank, determinant, dimension, and the links between them](https://reader034.vdocuments.us/reader034/viewer/2022042703/56813296550346895d992cd9/html5/thumbnails/31.jpg)
The theoretical basis for polynomial interpolation
• The determinant of a vandermonde matrix
is non-zero, if all xi’s are distinct. Hence, we can always find the matrix inverse and solve the system of linear equations.
kshum ENGG2013 31