|
|
|
|
|
by razster
113 days ago
|
|
Oh sure it is! I’ve helped set up an AI cluster rack with four K2.5s. With some custom tooling, we built our own local enterprise setup: Support ticketing system
Custom chat support powered by our trained software-support model
Resolved repository with detailed step-by-step instructions
User-created reports and queries
Natural language-driven report generation (my favorite — no more dragging filters into the builder; our (Secret) local model handles it for clients)
In-application tools (C#/SQL/ASP.NET) to support users directly, since our software runs on-site and offline due to PPI
A cool repair tool: import/export “support file packet patcher” that lets us push fixes live to all clients or target niche cases
Qwen3 with LoRA fine-tuning is also incredible — we’re already seeing great results training our own models. There’s a growing group pushing K2.5s to run on consumer PCs (with 32GB RAM + at least 9GB VRAM) — and it’s looking very promising. If this works, we’ll be retooling everything: our apps and in-house programs. Exciting times ahead! |
|