Parameter

Parameter is simply a specialized version of tensor where requires_grad is always True. It is used only as weights and biases within layers.

See here for general Tensor documentation