I tried Matrix a few months ago, but the clients were pretty horrible compared to irssi. The only functional one was the ugly GUI one with emojis and all that.
I've tried a lot of very functional clients. I suppose you think of Element? There's also Cinny, Hydrogen (both web), Fluffychat, Nheko, gomuks. Maybe quaternion is more to your taste? Not sure if it supports E2EE.
Weechat-matrix-rs[1] is the fix for that, but it's not currently usable (I tried it yesterday, hard crashes trying to log in to a local homeserver). Maybe in a few more years.........