[nayname]

Seq2seq translator (which trains to translate from one human language to another) is not a good architecture to learn computer code.

[andyonthewings]

What can be used instead?

[nayname]

Another thing I like is NPI - https://arxiv.org/pdf/1511.06279.pdf. At the end, you can find NPI vs Seq2Seq charts

[nayname]

It would be easier not to represent computer code as a string of sentences, but to get some semantic structure from it. One way is to use a syntax tree - https://openreview.net/forum?id=rkxY-sl0W