Hard to get to know people properly during a talk.
I would stay unless the plane ticket is super expensive, or there are other commitments you have to make.