[duxup]

Tell them you're thinking if you want to do it or not... see what their response is.

After that you need to be willing to explain that "I appreciate your interest, but I want to keep my side project separate from work" and take whatever comes next (if anything).

Beyond saying that I wouldn't engage in discussing any details beyond politely declining without talking to the lawyer again.