determin.ant
04-determinants / 4.2

Module 4: Determinants

The Zero Determinant

Where you'll see this: a camera matrix with det = 0 maps 3D space onto a 2D image — intentionally losing depth information. In ML, a weight matrix approaching singularity means gradients vanish (the "vanishing gradient" problem). In control theory, a singular system matrix means the system can't be controlled in some direction.

When the determinant of a transformation is zero, something dramatic happens: the entire 2D plane gets crushed down to a line — or even a single point. No area survives.

What det = 0 means geometrically

A zero determinant means the two column vectors — the new homes ofı^\hat{\imath} and ȷ^\hat{\jmath} — are parallel (or one is zero). They no longer span a plane. Every point in 2D space gets mapped into that single line.

Watch the grid in the interactive as you push the "how singular" slider toward 1. The green grid lines compress together. When det = 0, all of 2D space has been flattened onto one line.

Information is permanently lost

Once a transformation with det = 0 is applied, you can't recover the original vector. Many different inputs map to the same output. The transformation is not invertible — there's no way to undo it.

det(A)=0    A is not invertible\det(A) = 0 \iff A \text{ is not invertible}

The null space grows

The set of all vectors that map to 0\mathbf{0} is called the null space of the matrix. When det ≠ 0, the null space contains only the zero vector. When det = 0, the null space is an entire line (in 2D) — all those vectors that "disappear" into the origin.

Try the "collapse direction" slider to change which line the plane collapses onto. Notice that the determinant stays near zero regardless of direction — the line the grid falls onto can be any orientation.

Near-zero is also trouble

In practice, exact zero rarely appears. But a matrix with a very small determinant is nearly singular — numerically unstable. Small errors in input produce huge errors in output. This is called ill-conditioning, and it's why numerical analysts worry about the condition number, not just the determinant.

Area ScalingInvertibility
drag the sliders — approach det = 0 and watch the grid collapse
îĵ
det = 0.5
collapse direction (θ)0.5 rad
how singular (0 = identity, 1 = fully collapsed)0.5
Area scaling: 50% of original