[teruakohatu]

Flux is quite a nice lower level library:

https://github.com/FluxML/Flux.jl

On top of that there are many higher level libraries such as Transformers.jl

https://github.com/chengchingwen/Transformers.jl