Y
Hacker News
new
|
ask
|
show
|
jobs
by
gfaure
942 days ago
Nice! The README mentions `LayerNorm` is implemented here, but while it's in the equivalence tests with PyTorch, I don't see it in the implementation.
1 comments
dauertewigkeit
942 days ago
It's part of the TensorLi definition where all the magic happens.
link
joennlae
942 days ago
That is true. I went for a simple implementation of the layer norm and included it in the tensorli definition. But it would have been better to define it as a moduli for clarity.
link