It works fine (using GPT3.5/text-davinci-003) with a conversation look-back (+auto-summarization of the lookback when it is too long). Many people claim its more factual too.
Hey! This is an option in the settings. You can type !gp to view settings and !gs to change them. For your case,
!gs summarize_conversations True
!gs summarize_threshold (token amount to summarize at)