Hacker News new | ask | show | jobs
by steve_adams_86 1147 days ago
If this works well, are you interested in training a model specifically around the domain you work in so you could get deeper integration with your product?

I have a personal project similar in concept to flux, but rather than working at the circuit level, it's at the device, firmware, and infrastructure level. I've been trying to use GPT to intuit how to network devices using different protocols, such that it might be easier for lab techs (for example) to discover how to manage and maintain their experiment tooling and infrastructure. It's really hard, though. The outputs and level of integration are mind-bendingly good, but... It's not perfect, which makes it too clumsy or even dangerous for what I want to build.

I think I envision something like GPT transforming human language into prompts for a narrower model with more predictable outputs, which is far more aware and capable with the application's logic and data. The user experience could then give you the conversational ease, yet far better application integration as well.

Anyway, just curious what you're thinking and very excited about projects like this. This is really cool.

1 comments

Yea def looking into this

We already use a multi model approach and mix of non deterministic and deterministic tooling in the pipeline to optimize for a given task

Lots of more work to be done here

The flux docs indicate that you're using a custom-trained LLM and in another comment it was mentioned you're using LangChain (to integrate non-deterministic tooling perhaps). Just curious, but are you using some combination of your own model, GPT3/4, and calculators / datasheet readers / etc?
The answer is: all of it!

Not everything is in prod yet but we def combine all the things you can imagine to pull this off