I've had it fail to get a basic regex right, but simultaneously, found it able to model my custom problem using the z3 constraint solcing framework, which I'd have struggled to do myself. Regular expressions are probably harder for it to get right easily, at least not without prompting it to first think through step by step ehat each piece of a regex should be or something.