Hacker News new | ask | show | jobs
by ch4s3 15 days ago
It’s machine learning, which people routinely called AI not so long ago.
2 comments

ML was always marketed separately as AI/ML, with AI being things like CNNs/RNNs/BERTs and such. Always felt like a distinction without a difference.
Laypeople are changing how “AI” is used in common language, like they previously did for “algorithm” and “crypto”.

The textbook definition of AI is a system that solves problems that are difficult for humans. Whether the approach uses formal logic, machine learning, neural networks as a special case of machine learning, optimization, search problems, etc. does not matter.

I don't think so. ML was always associated with AI. When it wasn't, it was called statistics.
I never heard people calling machine learning "AI" until large language models made it trivial to market it as such. Like, I remember back when Netflix, for instance, was going around advertising how machine learning (not AI) powers their recommendations.
> I never heard…

You should listen better. The University of Edinburgh had an entire Department of Artificial Intelligence when I was an undergrad there in the 1990s, and one of the things it researched was machine learning.

I don't see how including machine learning under the artificial intelligence umbrella counts as calling machine learning AI.
My local supermarket places the almond milk in the dairy section, and some people find this very upsetting.
My local cvs refused to let me buy non-alcoholic Bloody Mary mix aka spicy tomato juice without ID, because it was slotted in the alcoholic category.
That example kind of illustrates my point though? ML being in an AI book doesn't mean ML is AI, just as being in the dairy section does not make almond milk dairy.
It illustrates that some people can’t distinguish between a useful label by association for the general public, and their own desperate compulsion to litigate hair-splitting category distinctions.

Someone who was truly on the ball on this matter might’ve observed that Edinburgh in the 90s was so balkanized by internecine personality conflicts that most research that might later be strictly labelled “machine learning” actually took place in adjacent units and not directly under the DAIry. But I suppose you haven’t heard that, either.

Ed: I disagree. My recollection is that machine learning was routinely sold as “AI” even when it obviously wasn’t. (IBM’s Watson was good at Jeopardy but not real medical applications.)

This isn’t exactly the same, but nothing in the book Paradigms of Artificial Intelligence would be considered AI today.

You must be thinking of a different machine learning. All the on-device machine learning, backend machine learning, OCR, etc. was all called "machine learning" before LLMs. Yes, the field of artificial intelligence still existed, often used machine learning, and called the result "AI". But Apple would call keyboard prediction machine learning. Microsoft would call OCR machine learning. YouTube called machine transcription machine learning. Google called camera image enhancement machine learning.

Microsoft now calls everything AI (actually mostly "Copilot"). YouTube now calls everything AI (including genuine LLMs and generative features, but also everything it used to call machine learning). Google now calls everything AI (including everything it used to call machine learning). Apple is seemingly the only one immune.

My argument is not that no one ever used "AI" to refer to a product that utilized machine learning, but rather that the term of art in the industry for machine learning itself was actually "machine learning", not "AI", until LLMs took over and made it "AI".

You would not pull a library off the shelf for "AI", it would be for machine learning. You would not implement and perform "AI", but machine learning. Even central parts of the AI ecosystem like PyTorch advertise as being for "deep learning", which is a subset of machine learning. Not "AI".

Counter example, the book that is the foundation of much coursework and learning for people in AI, has a whole section on "Machine Learning" with all that k-means and such in there - https://aima.cs.berkeley.edu/
I'm really not sure how that's a counterexample. The section is called machine learning, not AI. Machine learning is a useful tool for artificial intelligence, so I'd be surprised if a book about AI did not talk about it.
I'm saying that Machine Learning was borne of AI from the very beginning. ML has become specialized enough that we may later (much much later) declare it somehow larger/separate/overlapping, but it originated from AI as the generic umbrella.

https://en.wikipedia.org/wiki/Machine_learning

Machine learning is just what we call AI that works.
Thank you. I was starting to think the history revision was almost true, but your recollection is very much in sync with my own. Everything was machine learning, nobody talked about AI unless it was for research, now marketing has changed that, unfortunately.
> Everything was machine learning, nobody talked about AI unless it was for research

Machine learning was AI. The specific wording was a branding choice, because "AI" was a deeply stigmatized brand. ( https://en.wikipedia.org/wiki/AI_winter ) But there was not a conceptual division.

There's a close analogue to how modern genetic researchers are happy to tell you that your genome is not informative as to your "race", but it is informative as to your "ancestry".

For a long time, AI was a bad word that stood for unfulfilled promise. See AI Winter. Hence, researchers strictly avoided the term while still working on learning algorithms, the same that power LLM training.
Yes, because we had the same stupid arguments then: "that's not AI!"

So machine learning became the marketing.

What makes them stupid?
It's stupid because there's no formal definition of what counts as AI, so we repeat the same conversation every time. Hence the joke ML is just AI that works.

There's a book from 1995, called Artificial Intelligence: A Modern Approach, by by Stuart Russell and Peter Norvig, which gives the definition "AI is the study of agents that receive percepts from the environment and perform actions." but doesn't define intelligence.

https://aima.cs.berkeley.edu/2nd-ed/preface.html

If we go with that, though, I'd say AI is anything that uses a model to make decisions instead of hand written "if" statements.

I personally would find it sufficient just to prove both that AI can exist without ML and that ML can exist without AI. The former is easy to prove, since AI has essentially existed since even before computing, while the latter is harder to prove, since ML as a field was created for AI.

> If we go with that, though, I'd say AI is anything that uses a model to make decisions instead of hand written "if" statements.

Hand-written if-statements are a model though...

I would say AI is anything with the intention of performing as a human does. In my opinion, LLMs are AI because they're designed to either perform a human role, or be addressable like a human to a user. (In general I do not agree with implying intelligence by humanity or that it is exclusive to humanity, but it is genuinely the easiest way for me to explain this here.)

Even LLMs that are used as part of harnesses or backend services would count for this, because you could technically replace the model with an equivalent human and they would be able to read and write in its place.

And pre-LLM AI would also count for this, because the whole selling point of AI is that it's like a human in some way or could perform as a human does in some way. Even if it's purely for entertainment value or whatever, if the entertainment value includes that it seems like a human.

But uses of ML that have nothing to do with this would not count, like for example camera image enhancement. You could say a human could sit there and work through some algorithm manually (like from a book, etc) but that's not what image enhancement algorithms are doing. Now if you let an LLM have access to human-UX-ful photo editing tools and let it iterate or etc. then that would be AI but that's another thing.

It's difficult to define precisely exactly what this definition is though. Different people have different ideas of what "performing as a human does" means. If the ML algorithm is executing machine code instructions to perform a task then could a human execute the same machine code instructions by hand to prove that it's AI? No, because the human has to be in place of it, not emulating it. The human would have to take its inputs and give its outputs, without depending on its definition. So, then, it depends on where you define the boundaries of the system. LLMs typically output in tokens, so would a human have to think in tokens? No, because the use of tokens is as a text encoding, and humans are perfectly free to use tools in their work, etc. A human being able to read and write text in English would still prove that a language model that reads and writes the same but in tokens is AI as long as they would be more or less interchangeable.

Of course, today's LLMs are not really true replacements for humans but I'm not talking about performance here, just where they can be positioned. AI to me is more of an intention than a technology -- any technology can be AI depending on how you use it. ML however is a technology, no matter the intention.

In 2011, I took an AI course at my university and it was all perceptrons and neural networks.
I took one longer ago than that and it wasn't all perceptrons and neural networks. It included other things too, like: planning, search methods, inference engines, decision trees, ...
Yeah, in my university there were two AI professors, one did neural networks, and one did search stuff, and it depended on whom you are assigned to.