Hacker News new | ask | show | jobs
by ericjang 3251 days ago
Interesting points. What would you consider an adequate task that demonstrates a program/robot has acquired "semantic understanding"?
1 comments

Understand instruction in natural language.

For example:

1.'grab that red ball'

2.'turn the handle on the door 90 degree then pull it out'.

Just like how people would do it, a video and a piece of instruction listed and a label to indicate whether this task is a success or not. Then you show a different setting and a new instruction, if the model successfully generalize and understand the semantics behind it, it should carry out the instruction successfully.