Implementing Positional Encoder Layer in PyTorch

Implementing Positional Encoder Layer in PyTorch note: made a mistake on - torch.exp(torch.arange(0, dimension, 2).float() * (-math.log(10000) / dimension)) it computes for vector exponent - one for each even dimension index.