This sheet develops the rational canonical form and Jordan canonical form—the definitive structural classifications of linear transformations up to similarity.
Commentary. The characteristic polynomial tells us the eigenvalues; the minimal polynomial tells us the largest Jordan blocks. But to fully understand a linear transformation, we need to know the precise block structure. The rational canonical form works over any field, using invariant factors. The Jordan canonical form requires the characteristic polynomial to split completely (e.g., over ). Together, they provide a complete invariant for similarity of matrices.
Prerequisites. This sheet uses the following results from earlier sheets:
- Eigenvalues, characteristic polynomial, minimal polynomial (Sheet 10)
- PIDs, UFDs, polynomial rings (Sheet 9)
- Cayley-Hamilton theorem (Sheet 10)
- Linear transformations, matrices, vector spaces (Sheet 10)
Review: Similarity and Invariants#
Definition 11.1. Two matrices are similar, denoted , if there exists an invertible matrix such that:
Theorem 11.2. Similar matrices have the same:
- Characteristic polynomial
- Minimal polynomial
- Eigenvalues (with algebraic multiplicities)
- Rank
- Trace
- Determinant
Theorem 11.3. The converse is false: matrices with the same characteristic and minimal polynomials need not be similar.
Example 11.4. and have the same characteristic polynomial but different minimal polynomials: , . They are not similar.
Exercise 11.5. Show that similar matrices have the same trace and determinant.
Exercise 11.6. Find two non-similar matrices with the same characteristic polynomial .
Cyclic Subspaces and Cyclic Vectors#
Definition 11.7. Let be a linear transformation and . The cyclic subspace generated by is:
Definition 11.8. A vector is a cyclic vector for if .
Theorem 11.9. If is a cyclic vector for , then the set is a basis for .
Theorem 11.10. If has a cyclic vector , then the matrix of with respect to the basis is the companion matrix of the minimal polynomial of .
Example 11.11. Let have matrix . The vector is cyclic, and the minimal polynomial is .
Exercise 11.12. Show that is a cyclic vector for the companion matrix .
Exercise 11.13. Let be defined by . Find a cyclic vector for .
Exercise 11.14. Prove Theorem 11.9.
Companion Matrices#
Definition 11.15. The companion matrix of a monic polynomialis:
Theorem 11.16. The characteristic and minimal polynomials of the companion matrix are both equal to .
Example 11.17. The companion matrix of is:
Exercise 11.18. Write the companion matrix of .
Exercise 11.19. Show that has cyclic vector .
Exercise 11.20. Prove Theorem 11.16.
Rational Canonical Form#
Definition 11.21. Let be a linear transformation. A decomposition into -invariant subspaces is a cyclic decomposition if each is cyclic (i.e., has a cyclic vector).
Theorem 11.22 (Cyclic Decomposition Theorem). Every linear transformation on a finite-dimensional vector space over a field has a cyclic decomposition.
Theorem 11.23 (Rational Canonical Form). Every matrix is similar to a block diagonal matrix:where each is monic and . The polynomials are the invariant factors of , and they are uniquely determined.
Theorem 11.24. The last invariant factor is the minimal polynomial of .
Theorem 11.25. The product of all invariant factors is the characteristic polynomial:
Example 11.26. If has invariant factors , , then and . The rational form is:
Exercise 11.27. Find the rational canonical form of a matrix with invariant factors , , .
Exercise 11.28. Show that the rational canonical form of a diagonalizable matrix is diagonal.
Exercise 11.29. Show that the invariant factors determine the matrix up to similarity.
Jordan Canonical Form#
Definition 11.30. A Jordan block of size with eigenvalue is the matrix:
Theorem 11.31 (Jordan Canonical Form). Let have characteristic polynomial that splits completely over (i.e., all eigenvalues lie in ). Then is similar to a block diagonal matrix:The Jordan blocks are uniquely determined up to order.
Theorem 11.32. The number of Jordan blocks for eigenvalue equals the geometric multiplicity of , i.e., .
Theorem 11.33. The size of the largest Jordan block for eigenvalue is the multiplicity of as a root of the minimal polynomial.
Theorem 11.34. The sum of the sizes of all Jordan blocks for eigenvalue equals the algebraic multiplicity of .
Example 11.35. A matrix with characteristic polynomial and minimal polynomial could have Jordan blocks: or or . Which one occurs depends on the geometric multiplicity.
Exercise 11.36. Find all possible Jordan canonical forms for a matrix with characteristic polynomial and minimal polynomial .
Exercise 11.37. Let be a matrix with and . What are the possible Jordan forms?
Exercise 11.38. Prove Theorem 11.32.
Computing the Jordan Form#
Definition 11.39. For a matrix and eigenvalue , the generalized eigenspace is:
Theorem 11.40. The number of Jordan blocks of size at least for eigenvalue is:
Theorem 11.41. The number of Jordan blocks of size exactly for eigenvalue is:
Example 11.42. Suppose for :
Then , , . So there are 2 blocks of size 1 and 2 blocks of size 2.
Exercise 11.43. Let have , , . Determine the Jordan blocks for .
Exercise 11.44. Find the Jordan canonical form of:
Applications of Jordan Form#
Theorem 11.45. The Jordan canonical form allows computation of functions of matrices. If , then:where is computed blockwise.
Theorem 11.46. For a Jordan block :
Example 11.47. The exponential of a Jordan block:
Exercise 11.48. Compute for .
Exercise 11.49. Use the Jordan form to compute for .
Relationship to Rational Canonical Form#
Theorem 11.50. If the characteristic polynomial splits completely over , the rational canonical form can be refined to the Jordan canonical form.
Theorem 11.51. The invariant factors determine the Jordan form and vice versa, when the field is algebraically closed.
Example 11.52. Over , invariant factors , correspond to Jordan form .
Exercise 11.53. Convert the invariant factors , to Jordan form over .
Exercise 11.54. Prove that two matrices are similar over iff they have the same Jordan canonical form (up to block order).
The Minimal Polynomial and Jordan Blocks#
Theorem 11.55. The minimal polynomial of a Jordan block is .
Theorem 11.56. For a matrix in Jordan canonical form, the minimal polynomial is:where is the size of the largest Jordan block for eigenvalue .
Theorem 11.57. The characteristic polynomial is:where is the algebraic multiplicity of (sum of sizes of all Jordan blocks for ).
Exercise 11.58. Let have Jordan form . Find and .
Exercise 11.59. Let have and . What are the possible Jordan forms?
Summary#
We have introduced:
- Similarity invariants: characteristic and minimal polynomials
- Cyclic subspaces and cyclic vectors
- Companion matrices
- The Cyclic Decomposition Theorem
- Rational Canonical Form via invariant factors
- Jordan blocks and Jordan Canonical Form
- Computing Jordan form using generalized eigenspaces
- Applications: computing powers, exponentials, and functions of matrices
- The relationship between rational and Jordan forms
- The minimal polynomial of a Jordan block