.In the following I deviate from standard matrix element notation because it is hard to differentiate terms that only use different subscript.

.

⌊           ⌋
  a  b  c  d
|| e  f  g  h||
⌈ i  j  k   l⌉
  m  n  o  p⌊   ⌋
  X1
|| X2||
⌈ X3⌉
  X4 =⌊  ⌋
  k1
|| k2||
⌈ k3⌉
  k4

In the following I will not include the equations right side since we already know what happens there from the 3x3 case previously presented

We will use first step of Gaussian elimination to reduce the problem to a 3x3 determinant. The steps are:

After these steps the matrix looks is:

⌊  |     |   |     |   |     |   ⌋
   |a  d |   |b   d|   |c  d |
| .||     ||  .||     ||  .||     ||  0|
| | e  h|    |f   h|  | g  h|    |
|| |e   h|    |f   h |  |g   h|    ||
| ||     ||    ||     ||  ||     ||   0|
||  |i  l |   |j  l |   k|   l |   ||
|  |i   l|   |j   l|   |k   l|   |
|. ||     ||  .||     ||  .||     ||  0|
⌈   m   p     n   p     o  p     ⌉
     m         n         o      p

What remains for Gaussian reduction includes the upper left 3x3 of the matrix. The vertical bars denote 2x2 determinant. An observation seen with the 3x3 comes into play here:

|| ||     ||   ||     ||||
|. |f  h | . |g  h ||
| |j  l |   |k  l ||
||||     ||   ||     ||||
||j   l|   |k   l||
||n   p|   |o  p || = l|        |
|f  g   h|
|        |
||j  k   l||
|n  o   p|

The l term will exist in all cofactors and thus it will drop out as we have seen before.

So that taking any 2x2 subsquare is equivalent to a corresponding underlying determinant of a 3x3 matrix. Thus the above determinant is equal to:

||    ||
||a  d||
 e  h|       |
||f  g  h||
||j  k  l||
|n  o  p| -||   ||
||b  d||
f  h|       |
||e  g  h||
||i  k  l||
|m   o  p| + ||   ||
||c  d||
g  h|        |
||e   f  h||
|| i  j  l||
|m   n  p|

.

In this case the common factor is h which as f in the 3x3 case. We see the a,b,c cofactors all falling out of this equation in the right form. However the d terms are a mess. Gathering all the leftover terms we see:

|    |
||0  d||
|e  0|||       ||
||f  g  h||
||j  k  l||
 n  o  p -|   |
||0  d||
|f  0|||        ||
||e   g  h||
|| i  k  l||
 m   o  p + |    |
||0  d||
|g  0|||       ||
||e  f  h||
||i  j   l||
 m  n  p

You may be saying to yourself right now wooh way too many terms but look closer. Any term in the 3x3 determinants that come from the 1,1 and 1,2 positions cancels with other terms from elsewhere. Thus the phrase reduces to:

|    |
||0  d||
|e  0|||0  0  h||
||j  k  l||
||n  o  p|| -|   |
||0  d||
|f  0|||0   0  h||
|| i  k  l||
||m   o  p|| + |    |
||0  d||
|g  0|||0  0  h||
||i  j   l||
||m  n  p||

Which put in more familiar notation is:

-dh[e|    |
||j  k||
|n  o| + f|    |
||i  k||
|m   o| + g|     |
|| i  j||
|m   n|] ...... the negative sign coming from the fact the d terms are on the “negative diagonal”

Which is of course the partially expanded version of

-dh|       |
||e  f  g||
||i  j  k||
|m  n  o|

which of course is the cofactor matrix of d. Gathering up all the terms in one place we see the 4x4 determinant is

a|       |
||f  g  h||
||j  k  l||
|n  o  p| - b|       |
||e  g  h||
||i  k  l||
|m   o  p| + c|        |
||e  f   h||
||i   j  l||
|m  n   p| - d|        |
||e  f   g||
||i   j k ||
|m  n   o|

Similarly if you go to a NxN determinant and beyond the problem can be reduced to an N-1 x N-1. Thus recursion is invoked and all higher order determinants are thus known.