Y
Hacker News
new
|
ask
|
show
|
jobs
by
daishi55
50 days ago
I mean probably not or they wouldn’t have shipped it, right?
1 comments
boomlinde
46 days ago
Greater context size means more computational resources means more energy. Dedicating a portion of the context to telling the LLM not to refer to goblins then has a non-zero energy cost every time you prompt the model.
link