[jxf]

This will be an extremely difficult thing to do with just computer vision alone. Small changes in food preparation and recipes that don't yield very visible differences in the final product can have huge impacts on nutrition.

For example, a slice of chocolate cake prepared with non-caloric sweetener will look much the same as a cake prepared with brown sugar, but it'll have significantly fewer calories. (It'll also taste gross.)