Show HN: Olle – ChatGPT on Your Mac

[mpurham]

Hello HN,

I must admit, I might be fashionably late to the GPT party, but it was back in early February when I first delved into the world of ChatGPT. To say I was instantly captivated by its capabilities would be an understatement. You see, prior to my ChatGPT encounter, I often found myself laboring for days on various technical challenges, such as wrestling with cross-platform libraries and tracking down elusive memory leaks, among other things.

Then, around March of this year, I began my quest for solutions that could alleviate my development burdens, sparing me from having to create everything from scratch. However, the available options were either tied to costly monthly subscriptions, relied on cumbersome embedded web views, or simply failed to align with the model I had in mind (plugins, add-ons, ex.).

Today, I am thrilled to introduce Olle, your AI toolbar assistant for macOS. Whether you choose to utilize Olle as a seamless toolbar extension or engage in a conversation with it through chat mode, this tool will help you do more with less.

Let me know what you guys think as I care about what fellow devs have to say :)

Check out the tool here: https://olle.ai/

[smcleod]

Is this a native app, or an electron chrome wrapper?

*edit: Just downloaded it, while I can't seem to find a way to try its functionality without purchasing - it does look like a native app which is awesome! Only 27MB of memory and no chrome!

It's a shame it's $40AUD ($80 + IaP on the app store!) and doesn't have a demo or local LLM support but the concept seems solid.

If it had local LLM support I'd buy it right now.

[mpurham]

Certainly, it's native, haha. I'm a developer who really dislikes Chrome-based apps due to their excessive memory consumption.

The pricing in the app store is on the higher side because that version is quite outdated. However, the app is currently undergoing review, and once it's approved, I'll adjust the pricing to match what's listed on the website.

As for local LLM usage, that feature is coming very soon. This is why I have given OpenAI it's very own tab :)

[smcleod]

You are speaking my language! Love it. If local LLMs are coming soon(ish) you’ve just got yourself a customer and one that loves promoting the tools they use.

It’ll be great when it’s on the App Store too of course for a little more security assurance.

[stevesearer]

Super specific question, but when using the chat interface does pressing 'return' submit the prompt?

When I use the ChatGPT web interface I'm always nervous that I'm going to accidentally submit too early when I'm just wanting to go to the next line in my prompt.

[mpurham]

When you hit the 'return' key in the app, it inserts a newline character. This design choice was implemented to facilitate the input of lengthy text.

[Nextgrid]

This is nice, thinking about buying it. Couple questions:

1) Who manages the OpenAI access? Do I need to provide an API key or do you provide that (and if so how do you make it work with a fixed-price model)?

2) Is there any analytics/telemetry/etc? Does the app reach out to anything besides OpenAI?

[mpurham]

1. Users retain control over their API key (hence fixed model pricing structure).

2. Upon initial installation of the application, it transmits specific information about the app, including its version, build number, and platform. It's important to note that the app does not collect any other data, and all communication between the app and OpenAI occurs exclusively with your local machine.

[maxbaines]

I don't think you're late to the GPT party, lets remember how early we are in the AI timeline. It's all of us building with AI that'll actually make it useful. I'm going to try Olle, thanks.

[mpurham]

You're absolutely right – we're still in the early stages of the AI journey. Good luck with your AI tool as well

[maxbaines]

secret hint, if you want to try my AI tool, from today you can signup from the homepage.

[smcleod]

So I want _exactly_ this - but with local / offline LLMs - is there anything out there for this yet?

[mpurham]

As for local LLM usage, that feature is coming very soon. This was in mind since day one as I'm a huge fan of various LLMs

[smcleod]

Purchased on this alone to help fund development for local LLMs :)

[artur_makly]

congrats! any way to try it for free?

[mpurham]

thanks and there's currently no way to try it for free but, I've updated the pricing :)