Hacker News new | ask | show | jobs
by Gagarin1917 29 days ago
That’s not true. The different use cases of LLMs objectively use different amounts of tokens. AI coding agents can parse half a dozen or more files on each request, plus use a ton for thinking.

Writing an email barely uses any in comparison.
1 comments
ShinyLeftPad 29 days ago
> thinking

LLM doesn't think

> AI coding agents can parse half a dozen or more files on each request

yeh people never ever ask LLMs to write emails based on a number of docs and spreadsheets and other emails and Slack chats plus some websites and definitely won't iterate on it multiple times...

and parsing source code is peanuts compared to parsing a PDF

link
Gagarin1917 29 days ago
>LLM doesn't think

You don’t realize I’m referring to the process of generating a ton of text in an attempt to better address the request - a process that these LLM companies call “thinking”? Are you out of the loop or are you taking some kind of pointless stand here?

>yeh people never ever ask LLMs to write emails based on a number of docs and spreadsheets and other emails and Slack chats plus some websites and definitely won't iterate on it multiple times...

A worker might have one or two of those large requests a day. That stop doesn’t come close to agentic AI token usage. I’ve been applying for jobs daily, uploading both my resume and the job posting upwards of 6-7 times per day to these chatbots. I still never hit the free limit.

Agentic AI coding obviously uses far, far more. This really shouldn’t be surprising.

link
ShinyLeftPad 28 days ago
1. You seem to think that non programmers don't ask LLMs to program for them. Maybe that's why you're comfortable here thinking you're definitely will keep being in demand. Believe me they do ask an LLM to write for them various tools and bots and what LLM writes can in turn consume tokens like crazy be agentic or whatever the latest hype word is.

2. even without that uploading a resume is not "write emails based on a number of docs and spreadsheets and other emails and Slack chats plus some websites and iterate on it multiple times". one of those requests can easily be a month worth of your resume uploads at that rate.

link
Gagarin1917 28 days ago
>You seem to think that non programmers don't ask LLMs to program for them.

Because they largely do not. Are you actually under the impression that the average person is using chatbots to program? That’s wayyy off.

>Maybe that's why you're comfortable here thinking you're definitely will keep being in demand.

I’ve made no such claim, this a complete non-sequitur.

>Believe me they do ask an LLM to write for them various tools and bots and what LLM writes can in turn consume tokens like crazy be agentic or whatever the latest hype word is.

The average person does not do this. Come on, dude.

>even without that uploading a resume is not "write emails based on a number of docs and spreadsheets and other emails and Slack chats plus some websites and iterate on it multiple times".

It’s much closer to the average usage. All of that is still far less than agentic coding.

link
ShinyLeftPad 28 days ago
> using chatbots to program

They don't use chatbots to program. They use chatbots to get shit some. Sometimes that involves a program.

You know how a regular person can simply prompt a chatbot to generate a chatbot for them that would automate dating (incl messaging) and they get the full thing with handholding about what to press to get it running? Yeah. (If your model can't do it yet then try %someothermodel% or wait for a couple months.)

Your assumption that no one surely ever uses this for actual work purposes is funny. imagine you're preparing some slides and you need to process some data into it and the thing generates a script to do it. now imagine that generated script also calls some chatbot api and so on;)

link