The work on textual understanding is definitely still early days (though the press release makes it seem like it's understanding the entire LOTR, it's just reading a very structured short version) but already crazy impressive:
https://venturebeat.com/2015/03/26/facebooks-latest-deep-lea...
On visual QA, Francois Chollet's talk at the TensorFlow dev summit shows how easy it is to get a (again constrained to 1-word answers but still very impressive) video QA system working in like 20 lines of Keras:
https://www.youtube.com/watch?v=UeheTiBJ0Io&vl=en