Introduction to vector space Vector Spaces Examples Subspace Span Examples
Linear Algebra
Lecture - 05: Vector Spaces
Nijjwal Karak
BITS Pilani, Hyderabad Campus
[email protected]
February 10, 2024
1 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Outline
Introduction to vector space
Vector Spaces
Examples
Subspace
Span
Examples
2 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Introduction
Consider the following linear system
(
x+y =1
x−y =3
We can write it as
1 1 x 1
=
1 −1 y 3
Using row operations, we can transform it to the following system
1 1 x 1
=
0 −2 y 2
Using back substitution, we can find a solution.
3 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Introduction
Consider the same invertible system
1 1 x 1
=
1 −1 y 3
• Replace a column vector in the above coefficient matrix with any
arbitrary vector
• What happens to the solution. Does the solution exists ?
• Does that vector has any relation with the existing ones. Is it
dependent or independent ?
• This leads us to the concept of linear independence/dependence of
vectors
• The set of vectors with some special properties is a vector space
4 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Vector Spaces
Definition
A vector space is a set V of vectors on which two operations, namely
vector addition and scalar multiplication are defined. These operations
must satisfy the following conditions.
For every u, v, w ∈ V and for every a, b ∈ R
• u+v ∈V (Closure property of addition)
• au ∈ V (Closure property of scalar multiplication)
• u+v =v+u (Commutative law of addition)
• u + (v + w) = (u + v) + w (Associative law of addition)
• For every u ∈ V , there exists an element 0 ∈ V such that
0+u=u=u+0 (Existence of additive identity)
5 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Vector Spaces
• For every u ∈ V , there exists an element v ∈ V such that
u + v = 0 = v + u. v is called the additive inverse of u. It is
denoted by −u (Existence of additive inverse)
• a(u + v) = (au) + (av) (Distributive law for scalar
multiplication over addition)
• (a + b)u = (au) + (bu) (Distributive law for scalar multiplication
over addition)
• (ab)u = a(bu) (Associativity of scalar multiplication)
• 1u = u (Identity property for scalar multiplication)
6 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Vector Spaces
Definition
A vector space is a set V on which two operations, namely vector
addition and scalar multiplication are defined. These operations must
satisfy the following conditions.
For every u, v, w ∈ V and for every a, b ∈ R
• u+v ∈V • au ∈ V
(1) u + v = v + u
(1) a(u + v) = (au) + (av)
(2) u + (v + w) = (u + v) + w
(2) (a + b)u = (au) + (bu)
(3) There exists 0 ∈ V such that
0+u=u=u+0
(3) (ab)u = a(bu)
(4) There exists u ∈ V such that
u+v =0=v+u (4) 1u = u
7 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Vector Spaces: Examples
• The spaces R, R2 , · · · , Rn are vector spaces under the usual
operations of addition and scalar multiplication.
• The space V = {0} is the smallest vector space, called the trivial
vector space
• The space V = R+
8 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Vector Spaces: Examples
• The spaces R, R2 , · · · , Rn are vector spaces under the usual
operations of addition and scalar multiplication.
• The space V = {0} is the smallest vector space, called the trivial
vector space
• The space V = R+ is not a vector space
8 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Vector Spaces: Examples
• The spaces R, R2 , · · · , Rn are vector spaces under the usual
operations of addition and scalar multiplication.
• The space V = {0} is the smallest vector space, called the trivial
vector space
• The space V = R+ is not a vector space
• The set of all Mmn matrices
8 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Vector Spaces: Examples
• The spaces R, R2 , · · · , Rn are vector spaces under the usual
operations of addition and scalar multiplication.
• The space V = {0} is the smallest vector space, called the trivial
vector space
• The space V = R+ is not a vector space
• The set of all Mmn matrices is a vector space under the operations
of matrix addition and scalar multiplication on Mmn matrix.
8 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Vector Spaces: Examples
• The set of all 2 × 2 non-singular matrices is not a vector space
under the usual operations.
• The set of all 2 × 2 singular matrices is not a vector space under the
usual operations.
• These are examples under usual vector addition and scalar
multiplication operations.
9 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Subspaces
Definition
Let V be a vector space. Then W is a subspace of V if W is a
subset of V and W itself is a vector space under same operations
as defined on V.
• The sets V and {0} are subsets of the vector space V. These
are called the trivial subspaces of V.
Theorem
Let V be a vector space and W be a non-empty subset of V. Then
W is a subspace of V if and only if W is closed under vector
addition and scalar multiplication defined on V.
10 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Span of a Subset of a Vector Space
Definition
Let V be a vector space and let S be an non-empty subset of the vector
space V . Then the span of S is the set of all linear combinations of the
vectors in S. The span of S is denoted by span(S).
11 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Span of a Subset of a Vector Space: Remarks
Let S be a subset of a vector space V . Then S ⊆ span(S). Furthermore,
we have the following possibilities:
• span(S) = V
• span(S) ⊂ V . In this case span(S) is a proper subset of V
12 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Span of a Subset of a Vector Space: Questions and
Remarks
Let S be a subset of a vector space V .
• How can we determine whether a given vector belongs to the
span(S) ?
• How can we determine whether span(S) = V ?
• Span(S) is a subspace of V under the operations defined on V
• Span(S) is the smallest subspace of V containing S
13 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
14 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
15 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
16 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
17 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
18 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
19 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
20 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
21 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
22 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
23 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
24 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
25 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
26 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
27 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
28 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
29 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
30 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
31 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
32 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
33 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
34 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
35 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
36 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
37 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
38 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
39 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
40 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
41 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
42 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
43 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
44 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
45 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
46 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
47 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
48 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
49 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
50 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
51 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
52 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
53 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
54 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
55 / 56
Introduction to vector space Vector Spaces Examples Subspace Span Examples
Examples
56 / 56
