Diagonalizable Matrices

Euclidean (real) space	Unitary (complex) space
Real symmetric: AT= A	Hermitian: A*= A
Orthogonal: AT = A-1	Unitary: A* = A-1
Skew-symmetric: AT = -A	Skew-Hermitian: A* = -A
Real normal: AAT = ATA	Normal: AA* = A*A

Real Symmetric Matrices

Let A be any real symmetric matrix. Then there exists a real nonsingular matrix P such that P^-1AP is a diagonal matrix. This implies that all of the eigenvalues of A are real. This has an analogue for complex matrices. It is called the spectral theorem for complex matrices.

A matrix P is said to be orthogonal if and only if P is nonsingular and P^-1= P^T; that is if and only if, P^TP=I. An nxn matrix A is said to be orthogonally diagonalizable if it is possible to find an orthogonal matrix P such that  P^TAP = P^-1AP = D, a diagonal matrix.

Matrix is not orthogonal matrix, even though its column vectors are mutually orthogonal. However, it can be transformed into orthogonal matrix by normalizing each column vector, that is, by dividing each column vector by its norm (=length). Since these were bases for eigenspace, that merely replaces each basis vector with a "unit" basis vector. 

Any nxn real symmetric matrix A will be diagonalizable; in fact, such a matrix A is orthogonally diagaonlizable.  For a real symmetric matrix, the algebraic multiplicity of an eigenvalue is equal to its geometric multiplicity. Note: the number of linearly independent eigenvectors of A associated with the eigenvalue λ_i is the dimension of the eigenspace associated with  λ_i and is often called the geometric multiplicity.

Complex Matrices

A unitary space is a complex vector space with a complex inner product. It is defined as, for complex vectors u and v, the inner product is the complex number <u, v> = u^*v

It has the following properties:

1. <u, v> = <v, u>


2. <u, av+bw> = a <u, v> + b <v, w>, for all complex scalars a and b


3. <u, v> >= 0; with equality iff, u = 0

Two vectors u and v in a complex inner-product space V are orthogonal if and only if, <u, v> = 0. Other concepts for real inner-product spaces also carry over to the complex inner-product spaces, i.e. the norm ||u|| and the Cauchy-Schwarz inequality (| <u, v>|² <= <u, u> <v, v>), etc.
 

A unitary matrix and a unitary space are different. A unitary matrix is a special type of matrix in which the conjugate transpose of the matrix is its inverse. Since every matrix defines a linear transformation, and every linear operator T: V --> V on a finite-dimensional unitary space V has a matrix representation, linear transformation are called by the same names as are the matrices. 

Every Hermitian matrix A is normal and every unitary matrix U is also normal. 

The eigenvalues of an Hermitian matrix are all real numbers; furthermore, eigenvectors corresponding to distinct eigenvalues are mutually orthogonal. 

If A is an nxn Hermitian matrix with positive eigenvalues, then the function <u, v> = u^*Av is an inner product on Cⁿ.

Schur's Theorem

For every nxn complex matrix A, there exists a unitary matrix U such that M =  U^*AU is upper triangular. Furthermore, the diagonal entries of M are the eigenvalues of A. Unitary matrices are the complex analogues of orthogonal matrices in the real case. If the given complex matrix A is normal, then it is always the case that the upper triangular matrix M is a diagonal matrix, i.e., there exists a unitary matrix U such that  U^*AU is a diagonal matrix. 

Spectral Theorem

An nxn matrix A is normal if and only if it has a complete set of orthonormal eigenvectors.