Hacker News new | ask | show | jobs
by summarity 1189 days ago
> The GPU version is commercial software. Please contact...

Shame.

5 comments

The GPU version of libNC is available as a free binary, and you can find MIT-licensed source code implementing (training and inference of) transformers using libNC at https://bellard.org/nncp. (nncp was meant to be a submission to the Hutter Prize, which would have required open-sourcing libNC too, but it didn't qualify due to using AVX2 and too much RAM. At least the CPU version binary is MIT licensed since ts_server is.) I think it wouldn't be that big a project to support LLaMa starting from that code, although it is dense code.

Edit: licensing

That version of libnc_cuda.so doesn't seem to be compatible with ts_server though.
I think it's fine if a software legend (or anyone) wants to make some income.
"Shame. I cannot take the code / binary and run it as a SaaS efficiently." - HNers

Good for him to commercialize it, and at least he is not pretending to be a non-profit accepting VC money.

Countering SaaS-ifying by others can also be achieved through the AGPL or through the BSL (initially not open-source, reverts to open source after set period).

I do believe one of the failures of GPL was not being AGPL from the start.

Shame as in "it's a shame" or as in "shame on them"?
The former. Makes sense for their business model.
I'm pretty sure a dev skilled in ML and GPUs has no trouble modifying the MIT code (which runs on the CPU) to something that runs on GPUs...
The CPU version is provided under binary format only.
You're right : `The CPU version is released as binary code under the MIT license`. That's quite an unusual choice, not even sure how MIT would apply to that...
You can release whatever you want under MIT :) It grants you the right to use the binary for commercial projects (or any type of projects you want), to modify the binary, distribute it yourself and more. You cannot hold Bellard/the license holder liable for anything related to it, and you must include the license and copyright if you distribute it.

Seems pretty doable to me :)

I guess you could decompile it and redistribute that source if you were dedicated enough
The goal here is to allow you to redistribute while maintaining the copyright notice.