On the concept of matrix derivative

We discuss how to generalize the concept of vector derivative to matrix derivative, propose two definitions, a ‘broad’ and a ‘narrow’ one, compare the two definitions, and argue in favor of the narrow definition.