A matrix embedding refers to stacking multiple embeddings into a matrix form. This is common when dealing with sequences like:

Shape example:

If you have a sentence of 10 words and each word embedding is 300-dimensional, the sentence embedding matrix is:

shape = (10, 300)