Hacker News new | ask | show | jobs
by minimaxir 18 days ago
It definitely works in LM Studio, not Edge Gallery yet.
1 comments
dofm 16 days ago
Following up again, in case you see this. I was just in oMLX trying to set up the new 26B QAT models with MTP, and I noticed this message:

  Kernel iogpu.wired_limit_mb is only 48.0 GB; oMLX can only allocate up to 48.0 GB. Raise it in Terminal:
  sudo sysctl iogpu.wired_limit_mb=59392
Perhaps if you can increase the wired limit it will fit?
link