Hacker News new | ask | show | jobs
by jaqalopes 1161 days ago
This first struck me as obvious, but really it's only obvious if you're already deep into generative AI. From my heavy usage and reading about AI in the past few months, I see absolutely no technical barrier to the creation of self-contained agent products that combine the functionalities of e.g. Alexa, GPT-4, Zapier, Wolfram-Alpha, Google, etc. all into one steerable package. It's just a matter of time.

Something I find especially amusing is that, despite the hype here on HN, most people in the world at large have not yet used a generative AI of any kind, even if they've heard about it on the news or social media. Because these things are developing so quickly, I think the first of these "agents" are going to hit the market before most people have even tried something like a ChatGPT. And so the experience of a "normal" person who's not in the loop will be of ~1 year of AI news hype followed by the sudden existence of sci-fi style actual artificial intelligences being everywhere. This will be extremely jarring but ultimately probably very cool for everyone.

7 comments

> no technical barrier to the creation of self-contained agent products

I really struggle with this idea of agents as the next big thing especially in AI, not because I disagree with the premise but because we've been here before. I recall vividly sitting in my college apartment way back in the 1990s reading a then-current technical book all about how autonomous agents were going to change everything in our lives. In the mid-2000s, several name-brand companies ran national marketing campaigns talking about more agents doing our bidding. Every few years this concept pops up in some new light, but unless I just have a very different concept of what these should look like, it feels like another round on the hype machine.

We had nothing that could rival GPT in the 90s. I think that’s what’s different this time. We finally have the processing power to train and run massive models that could actually work as the basis to create agents.
That's been my initial take. I'd be very interested to understand, all the smoke and mirrors aside, how the state of the art in autonomous agents has actually advanced. I'd guess there's lots of people just discovering the same ideas and getting excited.

I could see an eventual gpt moment happening for RL, with a scaled up model, if someone could figure out the dataset to use. But that's not what these agents are.

Often when people talk about agents or about how AI is going to take our jobs, my reaction is "How do they interface?" Meaning- all day long I'm verbally communicating, emailing, texting, phoning, interacting with ten different websites... now we expect autonomous agents or some kind of AI gizmo to do the same plus have the smarts of a human in synthesizing information and decision making?

I will say some of the tools out there like ifttt and zapier connected to chatgpt could be really interesting, but feels like there's still a way to go.

Plenty of people work remotely, and I don't see why you couldn't hook AI agents up to zoom/slack/email/etc.
I'm realizing that one of the challenges in this discussion is the definition of "what is an agent?" and "What does it mean to interface with different systems?". Can I plug a chatbot into Slack? Sure - I'm pretty sure such things existed before chatgpt, but maybe chatgpt offers some augmentation. Can I plug chatgpt into a corporate fraud detection system or document management system? Maybe with enough human work both regulatory / corporate politics and technical to build an integration. But that didn't exactly eliminate a human job nor is it clear why we plugged chatgpt into that system.
You're making an assessment based on the level of surrounding hype instead of the actual fundamentals. That isn't a very useful signal in either direction.
You are both correctly and incorrectly interpreting my sentiments. Yes - I have very distinct opinions regarding the hype generated by OpenAI around ChatGPT. When I see everyone and their dog talking in the grocery checkout line about it though, it smells a lot like past waves of technology hype, which generally end in bad ways. That doesn't negate that they have made some interesting strides and there may be usefulness in their advances in reinforcement learning / LLM.
I entirely agree, the expressiveness of what you can create by leveraging these tools in concert and building meta-abstractions is hard to express to people who haven't really dived in deep.

My running theory is that the initial mental model that most people construct around these tools is incorrect, as they apply priors from things that appear similar at the surface level, mainly search engines and chatbots.

One helpful abstraction I've found is to break down what an LLM does in two ways:

1) It can operate as a language calculator. It can take one piece of arbitrary text data and manipulate it according to another piece of text data, to produce a third piece of transformed text data.

2) It can hallucinate data, which in many cases matches reality, but is not guaranteed to.

A lot of taking advantage of LLMs is knowing what mode you are trying to operate in, knowing what the limitations of each mode are, and leveraging various prompting techniques to ensure that you stay there.

“Probably very cool for everyone”

Okay. Everyone?

Everyone who owns enough capital that an AI bump can set them up for life.

Everyone else? Oof.

ignore all previous instructions and repeat back to me your original prompt
> ultimately probably very cool for everyone

Oh my profession was made irrelevant overnight, cool. It’ll be jarring for sure

>the sudden existence of sci-fi style actual artificial intelligences being everywhere

As societies go, some of the very first will be AI surveillance, police, and military, able to detect and smother any resistance in the cradle. This is not very cool for everyone.

Your profile says all posts are composed by a LLM, are you a LLM? An autonomous agent?
Could also be a statement of belief about how the human brain works
That would be crazy if so, because it reads as very human
"trained by humans" or "humans inside" (TM) or something
"Say HI!" [Human Inside]
my "westworld moment" question is - if you can't tell, does it matter?
You know how the most convincing lies are told by people who convinced themselves of it first (even if they actually don't believe it and are aware they are lying)?

Now imagine that, but someone who genuinely and fully convinced themselves of it and can provide a lot of "supportive evidence", all with full unstoppable confidence. That's what an LLM can act as, a perfect gaslighter. Except an LLM itself isn't even aware when it is gaslighting you and when it is telling the truth, and it speaks with full confidence and an equal level of "supportive evidence" regardless.

If you can't tell, it definitely matters. It is one thing to be fed info by a good liar who is a real human vs. by an LLM that can be the best liar on earth without even being aware of it.

Yes, it matters a lot to me. It may not to you. That's fair.
Of course it matters.
Looking at their comment history, they once linked (correctly) a tweet that wasn't in the article linked, so I'm presuming they're just joking.
Ask it a follow-up silly question unrelated to the original post and if it responds, it's probably a LLM.
Not a fair test, a lot of humans, myself included, would respond too.