[andai]

A few years ago I did the same thing with GPT-2 on my friend and I's WhatsApp conversation history.

So it would simulate conversations between us.

The result was hilarious yet at times uncomfortably accurate... like looking into a mirror...

[advaith08]

wow thats cool! Do you have the code put out somewhere?

[andai]

Tap the contact's name in WhatsApp (I think it only works on a phone) and at the bottom of that screen there's Export Chat.

There was some post-processing needed to get it in this format:

    Alice: blah

    John: blah blah

Edit: OP's GitHub README has instructions for exporting & preprocessing.

---

For finetuning GPT-2 I think we used this thing. I ran it on Google Colab. My friend ran it on his GPU, it should be doable on most modern-ish GPUs.

https://github.com/minimaxir/gpt-2-simple

I tried doing something with this a few months ago though and it was a bit of a hassle to get running (needed to use a specific python version for some dependencies...), I forget the details sorry!

[rchikhi]

Code for fine-tuning davinci (GPT-3): https://github.com/rchikhi/GPT-is-you