Great extension, yes. There is overhead when enabling the timing and buffers options, but sometimes it's not big [1]
But auto_explain solves only part of the task – you can see what happened, but cannot see the answers to "what if" questions. ("What if I used this index?")