Chapter 1 To 7
Chapter 1 To 7
Week 1
Matrices and Systems of Linear
Equations
Week 2
Matrices and Systems of Linear Equations Linear Equation System and Gaussian
Elimination
Week 3
Matrix Inverse
Definition of Matrix
Matrix is a set of elements arranged according to regular rows and
columns in a rectangular shape.
Week 1 Elements can be numbers (real/complex), function and others with
notation ( ) or [ ]
Matrices and Systems of Linear Matrix 𝐴 × (m rows and n collumns) can be written
𝑎 𝑎 ⋯ 𝑎
Equations 𝐴=
𝑎
q If m = n → square matrix
𝑎 ⋯ 𝑎
⋮ ⋮q If m ⋱= 1 →⋮ row matrix
𝑎 𝑎 ⋯ 𝑎
q If n = 1 → collumn matrix
5 6
1
2/9/2023
5. Transpose Matrix
Properties of the Transpose Matrix
If A is any matrix m x n, then 𝐴 , defined as a matrix n x m
which is obtained by swapping rows and columns from A, that If 𝑟 is a scalar and 𝐴 and 𝐵 are matrices then
is the first column of 𝐴 from the first row of A, the second
column of 𝐴 from the second row of A, etc. • (𝐴 ) = 𝐴
• (𝐴 + 𝐵) = 𝐴 + 𝐵
Example • (𝐴𝐵) = 𝐵 𝐴
1 2 3 2 1 1 −2
• (𝑟𝐴) = 𝑟𝐴
𝐴= 1 5 4 −9 → 𝐴 = 2 5 3
3 4 1
−2 3 1 4
2 −9 4
MIPA UBAYA 7 8
9 10
2
2/9/2023
3. Multiplication Matrix
Matrix 𝐴 = 𝑎 can be multiplied by a matrix 𝐵 = 𝑏 if the Example
number of columns of 𝐴 is the same as the number of rows of 𝐵,
𝐶 = 𝐴𝐵, 4 1 4 3
1 2 4 1
𝑝=𝑞
𝐴= ,𝐵 = 2 2 0 1 .
2 6 0 1 0 −1 3 1
𝑐 = 𝑎 𝑏 2 7 5 2
𝑥=1
Calculate the following (if any) :
with 𝐴 = 𝑎 ,𝐵= 𝑏 , 𝑝 = 𝑞, 1 ≤ 𝑖 ≤ 𝑚, 1 ≤ 𝑗 ≤ 𝑛. 1) 𝐴𝐵
2) 𝐵𝐴
13
15 MIPA UBAYA 16
MIPA UBAYA 17 18
3
2/9/2023
Exercises 3. If
1. Given the matrices: 1
6 −1 2 5 2𝑥 𝑥−𝑦 𝐴 = 𝑎 , and 𝐵 = [𝑏 −1 3].
𝐴= ,𝐵 = , and 𝐶 = .
0 2 −1 4 0 2 2
a) Calculate 2𝐴 + 𝐵 a) Calculate 𝐴 − 𝐶
b) If 𝐴 = 𝐶, determine the value 𝑥 and 𝑦.
b) Calculate 𝐴𝐵
2. Given the matrices: c) Find 𝑎 and 𝑏 so that 𝐴𝐵 = 𝐵 𝐴
3 0 4 −1 1 4 2
𝐴 = −1 2 , 𝐵 = , and 𝐶 = .
0 2 3 1 5
1 1
Calculate the following (if any):
a) 𝐵𝐶 b) 𝐶𝐵 c) 𝐶𝐴 d) 3𝐴 + 𝐶
19
22
𝑎 𝑥 +𝑎 𝑥 +…+𝑎 𝑥 =𝑏
, 2. There is no solution (LES is inconsistent)
⋮ ⋮ ⋮ ⋮ ⋮ m l y
𝑎 𝑥 +𝑎 𝑥 +…+𝑎 𝑥 =𝑏
where 𝑥 , 𝑥 ,…, 𝑥 are numbers that are not known and 𝑎’s x
and 𝑏’𝑠 are constants. 3. There are many solutions (LES is consistent)
y m
MIPA UBAYA 23
4
2/9/2023
𝑎 𝑥 +𝑎 𝑥 +…+𝑎 𝑥 = 𝑏
Types of LES writing: 𝑎 𝑥 +𝑎 𝑥 +…+𝑎 𝑥 = 𝑏
1. Equation form ⋮ ⋮ ⋮ ⋮ ⋮
𝑎 𝑥 +𝑎 𝑥 +…+𝑎 𝑥 =𝑏 Suppose
𝑥 + 𝑦 + 2𝑧 = 9
𝑎 𝑎 𝑎 𝑥 𝑏 2𝑥 + 4𝑦 − 3𝑧 = 1.
𝑎 𝑎 ⋯ 𝑎 𝑥 𝑏 3𝑥 + 6𝑦 − 5𝑧 = 0
2. Matrix form ⋮ ⋮ ⋱ ⋮ ⋮ =
⋮
𝑎 𝑎 ⋯ 𝑎 𝑥 𝑏 Determine the matrix and augmented matrix form of the
above LES.
𝐴 𝑥 = 𝑏
𝑎 𝑎 𝑏𝑎
𝑎 𝑎 ⋯
𝑏𝑎
⋮ ⋮ ⋱ ⋮ ⋮
3. Augmented matrix form 𝑎 𝑎 ⋯ 𝑎 𝑏
26
r1 r2
2 4 3 3r2 6 12 9 2 4 3 1 1 2
3 6 3 6 5 3 6 5
3
6 5 5
The equivalent of two matrices
Two matrices A and B are called equivalent (written A ~ B) if matrix B 3. Add a constant times one row to
another.
is obtained from matrix A by means of elementary operations.
1 1 2 1 1 2
r3 - 3r1
2 4 3 2 4 3
3 6 5 0 3 11
27
r1 r2
0 0 0 1 3
1 0 1 3 0 1 4 2
0 0 0 1 0 0 0 1
§ rows consisting entirely of zeros, then they are grouped
together at the bottom of the matrix. REM
0 0 0 0
0 0 0 0
5
2/9/2023
32
Gaussian elimination
Solution steps of LES 𝐴 𝑥 = 𝑏
1. Writes in an augmented matrix form 𝐴|𝑏
2. Transform the augmented matrix into row echelon form
using ERO
3. Solve by back substitution, or makes the matrix into reduced
row echelon form.
6
2/9/2023
Exercises
Determine the solution of following LES by eliminating Gauss – Jordan
1. x y z 1 3. x y 2 z w 1
2 x y 3z 0 2 x y 2 z 2w 2
3x y 2 z 4 x 2 y 4z w 1
3x 3w 3
2. 2 x2 3x3 1
3x1 6 x2 3x3 2
6 x1 6 x2 3x3 5
Matrix Inverse
Matrix 𝐴 × is said to be a non singular if there is a matrix 𝐵 ×
such that
𝐴𝐵 = 𝐵𝐴 = 𝐼
Week 3 Matrix 𝐵 is said to be inverse of 𝐴 (or matrix inverse of 𝐴).
7
2/9/2023
43 MIPA UBAYA 44
So we have
48
8
2/9/2023
MIPA UBAYA 49
Thank You
9
2/9/2023
Determinant
The determinant of a square matrix is a scalar (number)
obtained from the elements of a square matrix using a certain
WEEK 4 operation.
Determinant 𝐀 × is symbolized by |𝐀| or det (A)
3 4
Sarrus’s Rule
Calculate the determinant of the following matrix
1 −2 1
a11 a12 a13 a11 a12 −3 2
a) b) 0 1 2
6 2
det ( A) a21 a22 a23 a21 a22 −1 1 0
a31 a32 a33 a31 a32
a 11 a 22 a 33 a 12 a 23 a 31 a 13 a 21 a 32
a 13 a 22 a 31 a 11 a 23 a 32 a 12 a 21 a 33
5 6
1
2/9/2023
3 2 b2 2b1 3 2
(3)(6) (2)(0) 18
6 2 0 6
9 10
B B 2
2 3 2 3
1 3 0 1 6 8 6 8
C AB AB 14
1 4 2 3 8 13 8 13
11 12
2
2/9/2023
By using the properties of determinant, calculate the following How to Count Determinant
matrix
1. By using the properties of determinant or by reducing the row
3 2 1 3 to an upper/lower triangular matrix (ERO/ECO)
a) 2. By cofactors expansion
0 0 0 2
0 1 4 2
0 1 2 1
3 0 0 0
b) 2 2 3 2
4 1 3 2
1 1 2 2
13 14
Minors Cofactors
Minor of element 𝑎 of a matrix sized 𝑛 × 𝑛 is the determinant of a Cofactor of element 𝑎 , written by 𝑐
matrix sized (n - 1)x(n - 1) which is obtained by deleting the 𝑖th and Defined by 𝑐 = (−1) 𝑴
jth column.
Minor of 𝒂𝒊𝒋 is written by 𝑴𝒊𝒋 3 0 0 0
2 2 3 0 0
3 2
A c23 ( 1) 2 3 4 1 2 6
3 0 0 0 4 1 3 2
2 3 0 0
2 1 0 2
2 3 1 0 2 2
A M 23 4 1 2
4 1 3 2
1 1 2
1 1 2 2
15 16
Calculating Determinants by Cofactors Expansion Using the cofactor expansion along row 1, calculate the determinant
of the following matrix:
Theorem
Determinant of a matrix 𝑨𝑛 × 𝑛 can be counted by multiplies the 1 4 0
members of any row (column) by their cofactors and adds the a)
product 1 2 2
1 0 2
For any 1 ≤ 𝑖 ≤ 𝑛, 1 ≤ 𝑗 ≤ 𝑛,
det(𝑨) = 𝑎 𝑐 + 𝑎 𝑐 + ⋯ + 𝑎 𝑐 3 0 0 0
(cofactors expansion along 𝑗th column) 1
or b) 0 2 0
det(𝑨) = 𝑎 𝑐 + 𝑎 𝑐 + ⋯ + 𝑎 𝑐 4 1 3 2
(cofactors expansion along 𝑖th row)
1 1 2 2
17 18
3
2/9/2023
21 22
4
2/9/2023
26
Thank You
5
2/9/2023
Notations: 𝐚, 𝐛, 𝐯, or 𝑎, 𝑏, 𝐴𝐵
1
2/9/2023
7 8
Vectors in the Coordinate System (𝐑𝟑) Vector in the General Coordinate System
Vector in space (𝐑𝟑) Properties of vector operations
𝐯 = (𝑣1, 𝑣2, 𝑣3)
𝐮,𝐯,𝐰 are vectors in R2, R3 and 𝑘, 𝑙 are scalars
where 𝑣1, 𝑣2, 𝑣3 are real numbers or also called the vector component
𝑣1 1. 𝐮 + 𝐯 = 𝐯 + 𝐮 2. (𝐮 + 𝐯) + 𝐰 = 𝐮 + (𝐯 + 𝐰)
𝐯 = (𝑣1, 𝑣2, 𝑣3) = 𝑣2 = 𝑣 𝑖 + 𝑣 𝑗 + 𝑣 𝑘
𝑣3 3. 𝐮 + 𝟎 = 𝟎 + 𝐮 = 𝐮 4. 𝐮 + (−𝐮) = 𝟎
5. 𝑘(𝑙𝐮) = (𝑘𝑙)𝐮 6. 𝑘(𝐮 + 𝐯) = 𝑘𝐮 + 𝑘𝐯
If 𝑃 𝑃 has a starting point 𝑃1(𝑥1, 𝑦1, 𝑧1) and an end point 7. (𝑘 + 𝑙)𝐮 = 𝑘𝐮 + 𝑙𝐮 8. 1𝐮 = 𝐮
𝑃2(𝑥2, 𝑦2, 𝑧2) then 𝑃 𝑃 = (𝑥 − 𝑥 , 𝑦 − 𝑦 , 𝑧 − 𝑧 )
9 10
11 12
2
2/9/2023
13
Cross Product in 𝐑𝟑
If 𝐮 = (−7,2, − 1) and 𝐯 = (2,0,6) determine Suppose that 𝐮 = (𝑢1, 𝑢2, 𝑢3) and 𝐯 = (𝑣1, 𝑣2, 𝑣3) are two
a. 𝐮 ∙ 𝐯 vectors in R3. Cross product of 𝐮 and 𝐯 is
uxv
b. A component of 𝐮 which is parallel to 𝐯 v 𝑖 𝑗 𝑘
c. A component of 𝐮 perpendicular to 𝐯
𝐮 × 𝐯 = 𝑢1 𝑢2 𝑢3
u 𝑣1 𝑣2 𝑣3
Vector 𝐮 × 𝐯 perpendicular to 𝐮 and 𝐯 in the direction of the
right hand rule.
The magnitude of 𝐮 × 𝐯 is
‖𝐮 × 𝐯‖ = ‖𝐮‖‖𝐯‖sin
Or geometrically,
‖𝐮 × 𝐯‖ is an area of the parallelogram formed by 𝐮 and 𝐯
17 18
3
2/9/2023
19 20
Thank You
21
4
2/9/2023
Week 8
Chap 4 Vector Space Vector Space and Subspace
Week 9
Linear Independence
1
2/9/2023
2
2/9/2023
Problem 4.1
1. Suppose that 𝑽 = 𝑹 . If 𝒖 = (𝑢 , 𝑢 , 𝑢 ), 𝒗 = (𝑣 , 𝑣 , 𝑣 ) ∈ 𝑽
by addition operation 𝒖 + 𝒗 = (𝑢 + 𝑣 , 𝑢 + 𝑣 , 𝑢 + 𝑣 )
and multiplication by scalar 𝑘𝒖 = (𝑘𝑢 , 0,0), then investigate
whether 𝑽 forms a vector space?
2. Suppose that 𝑽 = 𝑴 is a 2 x 2 matrix set with real number Properties of Vector Space
elements, with matrix addition operations and matrix
multiplication operations with scalar 𝑘 real numbers. Show 𝑽 1. 0𝒖 = 𝟎
forms a vector space!
2. 𝑘𝟎 = 𝟎
3. (−1)𝒖 =− 𝒖
4. If 𝑘𝒖 = 𝟎 then 𝑘 = 0 or 𝒖 = 𝟎
3
2/9/2023
4
2/9/2023
Problem 4.2
1. Suppose that 𝑽 = 𝑹 by addition operation
(𝑢 , 𝑢 ) + (𝑣 , 𝑣 ) = (𝑢 + 𝑣 , 𝑢 + 𝑣 )
and multiplication by scalar
Week 9
𝑘(𝑢 , 𝑢 ) = (𝑘𝑢 , 𝑘𝑢 ).
𝑾 = {(0,0)} is a subset of 𝑽. Investigate whether 𝑾 is a subspace
Linear Independence
of 𝑽 or not!
2. Is the set of all vectors of form (𝑎, 1,1) a subspace of 𝑹
5
2/9/2023
Example:
Span
Suppose that 𝑺 = {𝒗 , 𝒗 , ⋯, 𝒗 } is a set of vectors in a vector space 𝑽
and 𝑾 is the set of all linear combinations of vectors in 𝑺.
𝑾 is called a spanned space by 𝒗 , 𝒗 , ⋯, 𝒗 and 𝒗 , 𝒗 , ⋯, 𝒗 is
called span 𝑾.
𝑾 = span(𝑺) or 𝑾 = span{𝒗 , 𝒗 , ⋯, 𝒗 }
𝑾 is a subspace of 𝑽.
6
2/9/2023
Theorem Theorem
A set 𝑺 with two or more vectors is not linear independent if and only
if one of the vectors in 𝑺 can be expressed as a linear combination of • A finite set which has a zero vector is linearly dependent.
the other vectors in 𝑺 • A set which have two vectors is linearly dependent if and only if one
Example: vector is the multiple of the other vector.
𝑺 = {𝒔 , 𝒔 , 𝒔 } with 𝒔 = (2, − 1, 0, 3), 𝒔 = (1, 2, 5, − 1), 𝒔 = • Suppose that 𝑺 = {𝒗 , 𝒗 , ⋯, 𝒗 } is a set of vectors in 𝑹 . If 𝑟 > 𝑛
(7, − 1, 5, 8). 𝑺 is a set of not linearly independent vectors. 𝒔 can then 𝑺 is linearly dependent.
be expressed as linear combination of 𝒔 and 𝒔 that is
𝒔 = 3𝒔 + 𝒔
Problem 4.4
Investigate whether the following vectors
1. 𝒂 = (−3, 0, 4), 𝒃 = (5, − 1, 2), and 𝒄 = (1, 1, 3) are linearly Week 10
independent in 𝑹 or not!
2. 6 − 𝑥 and 1 + 𝑥 + 𝑥 are linearly independent in 𝑷 or not! Basis dan Dimension
3. (3, − 1), (4, 5), dan (−4, 7) are linearly independent in 𝑹 or not!
7
2/9/2023
Basis Example
Show that 𝑾 = {(1,0), (0,1)} is a basis of 𝑹2!
Suppose that 𝑽 is a vector space, 𝑺 = {𝒗 , 𝒗 , ⋯, 𝒗 } is a set of vectors
in 𝑽. 𝑺 is called a basis of 𝑽 if (i) Will be shown 𝑾 is linearly independent :
1. 𝑺 is linearly independent 𝑎(1,0) + 𝑏(0,1) = (0,0) fulfilled only if 𝑎 = 𝑏 = 0 linearly
independent
2. 𝑺 spans 𝑽
(ii) Will be shown 𝑾 span 𝑹2 :
Every (𝑢1, 𝑢2) 𝑹2 can be expressed as the following linear
combination (𝑢1, 𝑢2) = 𝑢1(1,0) + 𝑢2(0,1)
so 𝑾 span 𝑹2.
So it is a proof that 𝑾 is a basis of 𝑹2.
** Note: 𝑾 is a standar basis of 𝑹2.
Example Dimension
Suppose that 𝑺 = {(1,0), (1,1)} is a basis of 𝑹2, Determine the Suppose that 𝑽 is a vector space, the number of vectors in a basis 𝑽 is
coordinate relative of 𝒖 = (3,2) to the basis 𝑺. called the dimension of 𝑽, denoted by dim(𝑽).
Answer: • {𝒗1, 𝒗2,… 𝒗n} is a basis of 𝑽 dim(𝑽) = n (𝑽 is finite dimensional)
𝒖 = 𝑐1(1,0) + 𝑐2(1,1) • {𝒗1, 𝒗2,…, 𝒗n, 𝒗n+1,…} is a basis of 𝑽 dim(𝑽) = (𝑽 is infinite
(3,2) = (𝑐1+𝑐2, 𝑐2) 𝑐2 = 2, 𝑐1 = 3 - 2 = 1 dimensional)
So (𝒖) = (1, 2) • 𝑽 = {0} (zero vector space) dim(𝑽) = 0
8
2/9/2023
Theorem Example
• If 𝑽 is a vector space of dimension n then
1. Since 𝑾 = {(1, 0), (0, 1)} is a basis 𝑹2 then dim(𝑹2) = 2
a. Any set with more than n vectors is not linearly independent.
b. There is no set with the vectors less than n spanning 𝑽 2. 𝑺 = {(1,1)} is not span of 𝑹2 because the number of vectors in
• All bases for a vector space of finite dimension have the same number 𝑺 = 1 < dim(𝑹2) = 2
of vectors.
• Let 𝑽 be a vector space of n dimension, if 𝑺 is a set of vectors at 𝑽 with 3. 𝑼 = {(−1, 1), (1, 0), (1, 1)} is not linearly independent in 𝑹2
exactly n vectors then 𝑽 is a basis of 𝑽 if 𝑺 is linearly independent or 𝑺 because the number of vectors in 𝑼 = 3 > dim(𝑹2) = 2
spans 𝑽.
Example Answer
Determine the basis and dimension of the solution space of the The solution to the homogeneous LES is:
following homogeneous system x1 s t , x2 s, x3 t , x4 0, x5 t
2x1 2x2 x3 x5 0 The solution can be written in the form
x1 x2 2x3 3x4 x5 0 x1 s t 1 1
x s 1 0
x1 x2 2x3 x5 0 2
x3 t 0 s 1 t
x3 x4 x5 0
x4 0 0 0
x 5 t 0 1
9
2/9/2023
Thank You
10
2/9/2023
1
2/9/2023
2
2/9/2023
Exercise 5.5
2 1
2. Given 𝐀 = , which of the following matrices is orthogonal
−1 3
to 𝐀 with respect to the inner product defined in Exercise 5.5 no 1.
1 1 2 1
𝐁= ;𝐂=
0 −1 5 2
3
2/9/2023
Chapter 6
Week 12
Linear Transformation Linear Transformation
1
2/9/2023
2
2/9/2023
3
2/9/2023
Exercise 6.5
3. Determine the standard matrix for inverse linear operators
T : R3 R3
(if any) which are defined successively by
a. Vector reflection by the plane xoy
b. Vector reflection by the plane xoz
c. Contraction by factors 1/5
4
2/9/2023
Chapter 7 Week 13
Eigenvalues and Eigenvectors Eigenvalues and
Problem Eigenvectors Problem
1
2/9/2023
2
2/9/2023
Exercise 7.3
Let
0 0 −2
𝑨= 1 2 1
1 0 3
a. Find the matrix 𝑷 that diagonizing 𝑨
b. Find the diagonal matrix 𝑫
c. Determine 𝑨