![Page 1: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/1.jpg)
Vectors, Matrices and their Products
Hung-yi Lee
![Page 2: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/2.jpg)
Learning Target
• A system of linear equations:
Describe a system of linear equations by Matrix-Vector Products
![Page 3: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/3.jpg)
Vectors, Matrices and their Products
Vector
![Page 4: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/4.jpg)
Vectors
• A vector v is a set of numbers
123
1 2 3
Column vectorRow vector
In this course, the term vector refers to a column vector unless being explicitly mentioned otherwise.
v= v=
![Page 5: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/5.jpg)
Vectors
• components: the entries of a vector.
• The i-th component of vector v refers to vi
• v1=1, v2=2, v3=3
• If a vector only has less than three components, you can visualize it.
123
v=
v
v1
v2
http://mathinsight.org/vectors_cartesian_coordinates_2d_3d#vector3D
v
v1
v2
v3
![Page 6: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/6.jpg)
Scalar Multiplication
𝑣 =𝑣1𝑣2
𝑐𝑣 =𝑐𝑣1𝑐𝑣2
𝑣
2𝑣
𝑣1 2𝑣1
𝑣2
2𝑣2
![Page 7: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/7.jpg)
Vector Additionhttp://mathinsight.org/vectors_cartesian_coordinates_2d_3d#vector3D
![Page 8: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/8.jpg)
Special Vectors
• zero vector 𝟎
• Standard vectors
Can be any size
𝟎 =0⋮0
𝟎 + 𝑣 = 𝑣
0𝑣 = 𝟎
![Page 9: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/9.jpg)
Vector Set
• A vector set can contain infinite elements
123
,456
,689
,902
A vector set with 4 elements
L =𝑥1𝑥2
: 𝑥1 + 𝑥2 = 1
![Page 10: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/10.jpg)
Vector Set
• Rn :We denote the set of all vectors with n entries by Rn .
![Page 11: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/11.jpg)
Vectors, Matrices and their Products
Matrix
![Page 12: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/12.jpg)
Matrix
• A matrix is a set of vectors
=2 3 53 1 −1−2 1 1
𝑎1 =23−2
𝑎2 =311
𝑎3 =5−11
𝐴 = 𝑎1 𝑎2 𝑎3
![Page 13: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/13.jpg)
Matrix
• If the matrix has m rows and n columns, we say the size of the matrix is m by n, written m x n
• The matrix is called square if m=n
• We use Mmxn to denote the set that contains all matrices whose size is m x n
1 2 34 5 6
2 rows
3 columns1 42 53 6
3 rows
2 columns
2 X 3 3 X 2
∈M2x3∈M3x2
先 Row 再 Column
![Page 14: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/14.jpg)
Matrix
• Index of component: the scalar in the i-th row and j-th column is called (i,j)-entry of the matrix
先 Row 再 Column
𝐴 =2 3 53 1 −1−2 1 1
(1,2)-entry
(3,1)-entry(3,3)-entry
![Page 15: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/15.jpg)
Matrix
• Two matrices with the same size can add or subtract.
• Matrix can multiply by a scalar
𝐴 =1 42 53 6
𝐵 =6 98 09 2
𝐴 + 𝐵 =7 1310 512 8
𝐴 − 𝐵 =−5 −5−6 −5−6 4
9𝐵 =54 8172 081 18
![Page 16: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/16.jpg)
Zero Matrix
• zero matrix: matrix with all zero entries, denoted by O (any size) or Om×n.
• For example, a 2-by-3 zero matrix can be denoted
• Identity matrix: must be square
• 對角線是 1, 其它都是 0
𝐴 + 𝑂 = 𝐴
0𝐴 = 𝑂
Sometimes In is simply written as I (any size).
𝐴 − 𝐴 = 𝑂
![Page 17: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/17.jpg)
Properties
• A, B, C are mxn matrices, and s and t are scalars
• A + B = B + A
• (A + B) + C = A + (B + C)
• (st)A = s(tA)
• s(A + B) = sA + sB
• (s+t)A = sA + tA
![Page 18: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/18.jpg)
Transpose
• If A is an mxn matrix
• 𝐴𝑇 (transpose of A) is an nxm matrix whose (i,j)-entry is the (j-i)-entry of A
𝐴 =6 98 09 2
𝐴𝑇 =6 8 99 0 2
(1,2)
(2,1)(3,2)
(2,3)
Transpose
以左上到右下的對角線為軸進行翻轉
![Page 19: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/19.jpg)
Transpose
• A and B are mxn matrices, and s is a scalar
• 𝐴𝑇 𝑇 = 𝐴
• 𝑠𝐴 𝑇 = 𝑠𝐴𝑇
• 𝐴 + 𝐵 𝑇 = 𝐴𝑇 + 𝐵𝑇
𝐴 =5 56 6
𝐵 =7 78 8
𝐴 + 𝐵 =12 1214 14 𝐴 + 𝐵 𝑇 =
12 1412 14
𝐴𝑇 =5 65 6
𝐵𝑇 =7 87 8
𝐴𝑇 + 𝐵𝑇 =12 1412 14
2𝐴 =10 1012 12
2𝐴 𝑇 =10 1210 12
𝐴𝑇 =5 65 6
2𝐴𝑇 =10 1210 12
![Page 20: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/20.jpg)
Vectors, Matrices and their ProductsMatrix-Vector Products
![Page 21: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/21.jpg)
Matrix-Vector Product
𝐴 =
𝑎11 𝑎12𝑎21 𝑎22
⋯ 𝑎1𝑛⋯ 𝑎2𝑛
⋮ ⋮𝑎𝑚1 𝑎𝑚2
⋱ ⋮⋯ 𝑎𝑚𝑛
m x n𝑥 =
𝑥1𝑥2⋮𝑥𝑛
𝐴𝑥 =
![Page 22: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/22.jpg)
Matrix-Vector Product
𝐴𝑥 𝑏=
Linear System
Coefficients are 𝐴
𝐴𝑥𝑥
![Page 23: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/23.jpg)
𝐴 =
𝑎11 𝑎12𝑎21 𝑎22
⋯ 𝑎1𝑛⋯ 𝑎2𝑛
⋮ ⋮𝑎𝑚1 𝑎𝑚2
⋱ ⋮⋯ 𝑎𝑚𝑛
𝑥 =
𝑥1𝑥2⋮𝑥𝑛
𝐴𝑥 =
Row Aspect
![Page 24: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/24.jpg)
𝐴 =
𝑎11 𝑎12𝑎21 𝑎22
⋯ 𝑎1𝑛⋯ 𝑎2𝑛
⋮ ⋮𝑎𝑚1 𝑎𝑚2
⋱ ⋮⋯ 𝑎𝑚𝑛
𝑥 =
𝑥1𝑥2⋮𝑥𝑛
𝐴𝑥
Column Aspect
= 𝑥1
𝑎11⋮
𝑎𝑚1
+ 𝑥2
𝑎12⋮
𝑎𝑚2
+⋯+ 𝑥𝑛
𝑎1𝑛⋮
𝑎𝑚𝑛
=
![Page 25: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/25.jpg)
Example
A𝑥1 + 4𝑥2 = 𝑏1
−3𝑥1 + 2𝑥2 = 𝑏2
14−3
2
−20.5
𝐴 =1 4−3 2
𝑏1𝑥1
𝑥2 𝑏2= 𝐴𝑥
-2
0.5
42
1−3
−26
RowAspect
ColumnAspect
Row 1
Row 2
column 1
column 2
21
![Page 26: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/26.jpg)
Matrix-vector Product
• The size of matrix and vector should be matched.
𝐴 =2 3 53 1 −1−2 1 1
𝑥 =1−1
𝐴′ =1 −12 31 4
A'' =
23
12
01
−1−3
![Page 27: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/27.jpg)
Properties of Matrix-vector Product• A and B are mxn matrices, u and v are vectors in Rn,
and c is a scalar.
• 𝐴 𝑢 + 𝑣 = 𝐴𝑢 + 𝐴𝑣
• 𝐴 𝑐𝑢 = 𝑐 𝐴𝑢 = 𝑐𝐴 𝑢
• 𝐴 + 𝐵 𝑢 = 𝐴𝑢 + 𝐵𝑢
• 𝐴𝟎 is the mx1 zero vector
• 𝑶𝑣 is also the mx1 zero vector
• 𝐼𝑛𝑣 = 𝑣
![Page 28: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/28.jpg)
Properties of Matrix-vector Product• A and B are mxn matrices. If 𝐴𝑤 = 𝐵𝑤 for all 𝑤 in
Rn. Is it true that 𝐴 = 𝐵?
𝐴𝑒𝑗 = 𝑎𝑗 for 𝑗 = 1,2,⋯ , 𝑛, where 𝑒𝑗 is the j-th standard vector in Rn
𝑒1 =1⋮0
𝐴𝑒1 = 𝑎1 ⋯ 𝑎𝑛1⋮0
= 1 ∙ 𝑎1 + 0 ∙ 𝑎2 +⋯+ 0 ∙ 𝑎𝑛
= 𝑎1
𝐴𝑒1 = 𝐵𝑒1
𝑎1 = 𝑏1
𝐴𝑒2 = 𝐵𝑒2
𝑎2 = 𝑏2
𝐴𝑒𝑛 = 𝐵𝑒𝑛
𝑎𝑛 = 𝑏𝑛
…… 𝐴 = 𝐵
![Page 29: Vectors, Matrices and their Productsspeech.ee.ntu.edu.tw/~tlkagk/courses/LA_2016/Lecture...Vectors •A vector v is a set of numbers 1 2 3 1 2 3 Column vector Row vector In this course,](https://reader034.vdocuments.us/reader034/viewer/2022042123/5e9ee152f0786b24d852b24d/html5/thumbnails/29.jpg)
Concluding Remarks
𝐴 =
𝑎11 𝑎12𝑎21 𝑎22
⋯ 𝑎1𝑛⋯ 𝑎2𝑛
⋮ ⋮𝑎𝑚1 𝑎𝑚2
⋱ ⋮⋯ 𝑎𝑚𝑛
𝑥 =
𝑥1𝑥2⋮𝑥𝑛
𝐴𝑥
= 𝑥1
𝑎11⋮
𝑎𝑚1
+ 𝑥2
𝑎12⋮
𝑎𝑚2
+⋯+ 𝑥𝑛
𝑎1𝑛⋮
𝑎𝑚𝑛
=
ColumnAspect
RowAspect