What is a tensor? And why isn't a matrix a tensor?

Note that this is only a first draft, a first sketch, but you should get an idea ;-). 

A tensor is a physical quantity. In one dimension, temperature is a tensor. One dimensional tensors are called scalars (tensor of zero oder). But the temperature is independent of its representation. You can specify it in Kelvin or in degree Celsius.