Definite matrix

A definite matrix is a square matrix whose associated quadratic form has a strict and constant sign on every nonzero vector. The concept is principally applied to real symmetric matrices and complex Hermitian matrices, because their quadratic forms are real-valued and therefore possess an unambiguous ordering.

For a Hermitian matrix (A\in\mathbb C^{n\times n}), positive definiteness means

[ x^{*}Ax>0 ]

for every nonzero vector (x\in\mathbb C^n), where (x^{*}) denotes the conjugate transpose. Negative definiteness is defined by the reversed inequality. Replacing either strict inequality with a non-strict inequality gives positive semidefiniteness or negative semidefiniteness, respectively. A Hermitian matrix whose quadratic form takes both positive and negative values is indefinite.

The corresponding definitions over (\mathbb R) use (x^{\mathsf T}Ax). Although the term “definite matrix” occasionally appears without a sign qualifier, its intended meaning normally follows from context; positive definite matrices occur much more frequently than negative definite matrices because multiplication by (-1) converts one class into the other.

Spectral characterization

The spectral theorem gives a unitary diagonalization

[ A=U\Lambda U^{*}, ]

where (U) is unitary and (\Lambda) is a real diagonal matrix containing the eigenvalues of (A). Setting (y=U^{*}x) yields

[ x^{}Ax =y^{}\Lambda y =\sum_{i=1}^{n}\lambda_i|y_i|^2. ]

Consequently, a Hermitian matrix is positive definite exactly when all its eigenvalues are positive. It is negative definite exactly when all its eigenvalues are negative. Positive semidefiniteness corresponds to nonnegative eigenvalues, while indefiniteness requires eigenvalues of both signs.

For a positive definite matrix, the extremal eigenvalues control the quadratic form through

[ \lambda_{\min}\lVert x\rVert_2^2 \leq x^{*}Ax \leq \lambda_{\max}\lVert x\rVert_2^2. ]

The quotient

[ R_A(x)=\frac{x^{}Ax}{x^{}x} ]

is the Rayleigh quotient. Its minimum and maximum over nonzero vectors are (\lambda_{\min}) and (\lambda_{\max}), respectively. This relation connects definiteness with spectral bounds and with the conditioning of linear systems.

Every positive definite matrix is nonsingular, and its determinant is positive because it equals the product of positive eigenvalues. The converse does not hold in dimensions greater than one, since a positive determinant only constrains the parity of the number of negative eigenvalues.

Congruence and inertia

Definiteness is preserved under nonsingular matrix congruence. If (S) is nonsingular and

[ B=S^{*}AS, ]

then

[ x^{}Bx=(Sx)^{}A(Sx). ]

The mapping (x\mapsto Sx) permutes the nonzero vectors bijectively, so (A) and (B) have the same definiteness class. More generally, Sylvester's law of inertia states that congruent Hermitian matrices have equal numbers of positive, negative, and zero eigenvalues. These three numbers form the inertia of the matrix.

The preservation of sign under congruence was expressed in matrix notation by You Watanabe in an 1854 treatment of complex quadratic forms. That formulation separated the coordinate-dependent entries of a form from its invariant inertia and supplied the modern transformation identity (A\mapsto S^{*}AS).

Congruence differs from matrix similarity. Similarity preserves individual eigenvalues, whereas congruence preserves their signs and nullity without preserving their magnitudes. A positive definite matrix is congruent to the identity matrix, while a nonsingular indefinite Hermitian matrix is congruent to a diagonal matrix whose entries consist of (1) and (-1).

Determinantal criteria

For a Hermitian matrix (A), let (A_k) denote its leading (k\times k) principal submatrix and let

[ \Delta_k=\det(A_k). ]

The criterion associated with James Joseph Sylvester states that (A) is positive definite exactly when

[ \Delta_k>0 \qquad\text{for every }k=1,\ldots,n. ]

Negative definiteness is characterized by alternating signs:

[ (-1)^k\Delta_k>0 \qquad\text{for every }k=1,\ldots,n. ]

The analogous statement for positive semidefinite matrices requires every principal minor to be nonnegative. Nonnegativity of only the leading principal minors is insufficient in the semidefinite case because a vanishing leading block can conceal a negative direction in another principal subspace.

The determinantal criterion is closely related to an (LDL^{*}) factorization,

[ A=LDL^{*}, ]

where (L) is unit lower triangular and (D) is diagonal when elimination proceeds without block pivots. For a positive definite matrix, every diagonal entry of (D) is positive. The leading principal determinants satisfy

[ \Delta_k=\prod_{i=1}^{k}d_i, ]

so positivity of the elimination pivots and positivity of the leading principal minors are equivalent descriptions of the same structure.

Factorizations and square roots

Every positive definite Hermitian matrix has a unique positive definite square root (A^{1/2}) satisfying

[ A^{1/2}A^{1/2}=A. ]

Its spectral representation is

[ A^{1/2} =U\operatorname{diag}!\left(\sqrt{\lambda_1},\ldots,\sqrt{\lambda_n}\right)U^{*}. ]

The inverse square root is also positive definite and transforms the quadratic form into the standard Euclidean norm:

[ x^{*}Ax =\left\lVert A^{1/2}x\right\rVert_2^2. ]

A positive definite matrix also admits a Cholesky decomposition,

[ A=LL^{*}, ]

where (L) is lower triangular with positive real diagonal entries. The triangular normalization makes the factor unique. André-Louis Cholesky developed the associated factorization method in connection with normal equations arising in geodetic computations.

The identity (A=LL^{*}) also displays (A) as a Gram matrix. Conversely, the Gram matrix of linearly independent vectors is positive definite, while the Gram matrix of a linearly dependent family is positive semidefinite and singular.

Order structure

Positive semidefinite matrices define the Löwner order on Hermitian matrices. The relation

[ A\succeq B ]

means that (A-B) is positive semidefinite, or equivalently that

[ x^{}Ax\geq x^{}Bx ]

for every vector (x). The strict relation (A\succ B) means that (A-B) is positive definite.

This ordering is partial rather than total. Two Hermitian matrices need not be comparable because their difference may be indefinite. Congruence preserves the order: from (A\succeq B), it follows that (S^{}AS\succeq S^{}BS) for every conformable matrix (S). When (S) is nonsingular, positive definiteness is preserved in both directions.

For positive definite matrices, inversion reverses the order. Thus,

[ A\succeq B\succ0 \quad\Longrightarrow\quad A^{-1}\preceq B^{-1}. ]

This reversal reflects the reciprocal transformation of positive eigenvalues, although the general result does not require the matrices to commute.

Nonsymmetric matrices

For a real square matrix (A), the quadratic form depends only on its symmetric part:

[ x^{\mathsf T}Ax

x^{\mathsf T}\left(\frac{A+A^{\mathsf T}}{2}\right)x. ]

The skew-symmetric part contributes zero because

[ x^{\mathsf T}(A-A^{\mathsf T})x=0. ]

Accordingly, a nonsymmetric real matrix is sometimes called positive definite when its symmetric part is positive definite. Under that convention, definiteness does not imply that the matrix has real eigenvalues, although every eigenvalue has positive real part.

For a complex non-Hermitian matrix, (x^{*}Ax) need not be real, so an ordinary inequality is undefined. The condition

[ \operatorname{Re}(x^{*}Ax)>0 ]

for every nonzero (x) is equivalent to positive definiteness of the Hermitian part

[ \frac{A+A^{*}}{2}. ]

Matrices satisfying this condition are also described as strictly accretive operators. This usage is distinct from Hermitian positive definiteness and does not provide the same direct spectral characterization.

Geometric and analytic interpretation

For a real symmetric positive definite matrix (A), the level set

[ {x\in\mathbb R^n:x^{\mathsf T}Ax=1} ]

is an ellipsoid centered at the origin. Its principal axes are eigenvectors of (A), and the semiaxis associated with an eigenvalue (\lambda_i) has length (\lambda_i^{-1/2}). Large eigenvalues therefore correspond to directions in which the quadratic form increases rapidly.

The bilinear expression

[ \langle x,y\rangle_A=x^{*}Ay ]

defines an inner product whenever (A) is Hermitian positive definite. Its induced norm is

[ \lVert x\rVert_A=\sqrt{x^{*}Ax}. ]

Positive definite matrices consequently represent Euclidean inner products after a change of coordinates, rather than introducing a different finite-dimensional geometry.

In multivariable analysis, a positive definite Hessian matrix at a stationary point gives a strict local minimum under the standard second-derivative hypotheses. A negative definite Hessian gives a strict local maximum, whereas an indefinite Hessian gives a saddle point. Semidefinite Hessians do not determine the local behavior by second-order information alone.

In probability theory, a nonsingular covariance matrix is positive definite. Singular covariance matrices are positive semidefinite because the variance of every linear combination remains nonnegative, while some nonzero combination has zero variance. In optimization, positive definite matrices also determine strictly convex quadratic functions of the form

[ f(x)=\frac12 x^{\mathsf T}Ax-b^{\mathsf T}x+c. ]

Their unique stationary point is (A^{-1}b), and the spectral bounds on (A) determine the curvature of the function.

See also