Systems of Linear Equations, Direct Methods

1
Lecture 15

• Systems of Linear Equations, Direct Methods

2
Lecture 15 Objectives

• Geometrically solve linear systems of eqns in 2
  vars
• Get the augmented matrix of a linear system of
  eqns
• Decide if a matrix is in (reduced) row echelon
  form
• Use elementary operations to reduce a matrix to
  (reduced) row echelon form
• Algebraically solve linear systems of equations
  using
• Gaussian elimination
• Gauss-Jordan elimination
• Find the value(s) of parameter(s) that make a
  linear system have
• a unique solution
• infinitely many solutions
• no solution

3
Example

• Solve the following equations
• x 3y ?1
• 3x 2y 4
• Note Geometrically you are looking for the
  intersection of the two lines in the x-y plane.
  Here we get a unique solution.

4
Example

• Solve the following equations
• x 3y ?1
• 3x 9y 4
• Note These are two different parallel lines.
  Thus, we get no solution (the solution set is
  empty). We call this system inconsistent.

5
Example

• Solve the following equations
• x 3y 1
• 3x 9y 3
• Note These are two identical lines. Thus, we get
  infinitely many solutions, namely y t (any
  arbitrary value), and x 1 ? 3t.

6
Example

• Solve the following equations
• x 2y ? 3z ?4
• 2x ? y 2z 10
• 3x y ? 4z 3
• Note Geometrically you are looking for the
  intersection of three planes in space.

7
Solution Step 1 Elimination

• x 2y ? 3z ?4 (1)
• 2x ? y 2z 10 (2)
• 3x y ? 4z 3 (3)
• We use Eq. 1 to eliminate x from Eqs. 2, 3
• x 2y ? 3z ?4 (1)
• ?5y 8z 18 (2)
• ?5y 5z 15 (3)
• Note Those 3 equations are equivalent to the
  original set of equations, i.e. they have the
  same set of solutions.

8
Solution Step 2 Elimination

• x 2y ? 3z ?4 (1)
• ?5y 8z 18 (2)
• ?5y 5z 15 (3)
• We now use Eq. 2 to eliminate y from Eq. 3
• x 2y ? 3z ?4 (1)
• ?5y 8z 18 (2)
• ?3z ?3 (3)
• Note Again, we get 3 equivalent equations, which
  can be easily solved.

9
Solution Step 3 Back Substitution

• x 2y ? 3z ?4 (1)
• ?5y 8z 18 (2)
• ?3z ?3 (3)
• We first get z, then y, then x
• z 1
• ?5y 8(1) 18, so y ?2
• x 2(?2) ? 3(1) ?4, so x 3
• Note Thus, we finally get the unique solution
  (point, or vector) x, y, z (3, ?2, 1).

10
Example (revisited)

• Solve the following equations
• x 2y ? 3z ?4
• 2x ? y 2z 10
• 3x y ? 4z 3
• A Simplified Method We only keep track of the
  coefficients of x, y, and z, as well as the right
  hand sides.

11
Solution Step 1 Form the Augmented Matrix
(Table)

• x 2y ? 3z ?4 (1)
• 2x ? y 2z 10 (2)
• 3x y ? 4z 3 (3)
• are abstracted in the augmented matrix

Note Each row represents an equation.
12
Solution Step 2 Perform the legal Elementary Row
Operations
13
Solution Step 3 We can stop and solve, or
continue to simplify
Thus, x 3 y ?2 z 1
14
The Elementary Row Operations

• Those are
• 1) Add a multiple of a row to another
• 2) Multiply a row by a nonzero constant
• 3) Interchange two rows
• Note These operations maintain the equivalence
  between the old and the new set of equations.
• I.e. the solution set remains the same.

15
In general We can solve any system (set) of m
linear equations in n unknowns

• a11x1 a12x2 ? a1nxn b1
• a21x1 a22x2 ? a2nxn b2
• ?
• am1x1 am2x2 ? amnxn bm
• by first getting the augmented matrix

16
Gaussian Elimination

• Here we then perform elementary row operations to
  find an equivalent matrix in row echelon form,
  i.e. with the following properties
• 1) All zero rows are at the bottom.
• 2) The first nonzero entry of a nonzero row is
  called a pivot. Each pivot lies to the left of
  any pivot below it.
• E.g.

17
Gauss-Jordan Elimination

• Here we go further to get an equivalent matrix in
  reduced row echelon form, i.e. with the following
  properties
• 1) All zero rows are at the bottom.
• 2) Each pivot lies to the left of pivots below
  it.
• 3) Each pivot must 1, and is the only nonzero
  entry in its column.
• E.g.

18
Example

• Find the solution of the system, whose augmented
  matrix is

19
Solution

• We perform row operations to get the reduced row
  echelon form

Thus x4 ?5 x3 2 x2 t x1 ?11 ? 2t
20
The Rank of a Matrix A

• rank(A) is defined as the number of pivots (or
  nonzero rows) in the (reduced) row echelon form
  of A.
• E.g.

has rank 3, since it is row-equivalent to
21
The Rank Theorem

• Let Ab be the augmented matrix of a linear
  system of m equations in n variables. Then
• 1) The system is inconsistent iff rank(A) lt
  rank(Ab)
• 2) The system has a unique solution
  iff rank(A) rank(Ab) n
• 3) The system has infinitely many solutions iff
  rank(A) rank(Ab) lt n, and
• Number of free variables n ? rank(A)

22
Example

• For what values of k does the system
• x ? 2y 3z 2
• x y z k
• 2x ? y 4z k2 have
• a) No Solution
• b) A unique solution
• c) Infinitely many solutions

23
Lecture 15 Objectives (revisited)

• Geometrically solve linear systems of eqns in 2
  vars
• Get the augmented matrix of a linear system of
  eqns
• Decide if a matrix is in (reduced) row echelon
  form
• Use elementary operations to reduce a matrix to
  (reduced) row echelon form
• Algebraically solve linear systems of equations
  using
• Gaussian elimination
• Gauss-Jordan elimination
• Find the value(s) of parameter(s) that make a
  linear system have
• a unique solution
• infinitely many solutions
• no solution

24

• Thank you for listening.
• Wafik