[bottom999mottob]

Yeah I refuse to give Oracle a dime, so I'll keep that in mind.

I only run the tiny models for fun (the CPU inference is enough) and any complex coding tasks go through GPT or Claude. Mainly just using the one instance as another backup server, run scrapers, host a bunch of containers, and experiment with networking services. I don't see a reason to split up my one instance, but maybe in the future.

[SOLAR_FIELDS]

Yeah the main reason that I’m interested in using OCI is because it’s free and it actively takes money away from them by me doing this. So I will happily continue to take advantage of Larry, I know he would do the exact same to me but many times worse. So it’s a great solution as long as it lasts. I get to make Larry inconsequentially poorer every second my stuff runs, plus I get some free cloud compute. Win win

[kstrauser]

This is the first thing I’ve ever read that has me considering spinning up an OCI setup.

[SOLAR_FIELDS]

It’s a use case half driven by value and half driven by spite, and 100% about selfishly taking things at the detriment of others - which just feels so perfectly on brand for everything having to do with Larry Ellison. A microdose of his own medicine, if you will

[bottom999mottob]

Making Larry lose money while you sleep, truly a reverse Uno :)

[ipaddr]

What model are you running? I found it to be too slow.

[bottom999mottob]

SmolLM v2 1.7GB Q8 has been running pretty fast. Only needs about 3.5GB of memory. I think it's fine for chatting, but it's only really good for Python code compared to larger models.

Deepseek-coder is pretty slow, even with the quantized models.

https://huggingface.co/blog/smollm

[shiroiushi]

>Yeah I refuse to give Oracle a dime

The parent only paid $0.01. Even $0.10 should be fine, even if you strongly dislike Oracle: the cost to Oracle for charging your card $0.10 is more than that, so they're actually losing money by charging you such a small amount!