|
|
|
|
|
by bob1029
1204 days ago
|
|
It is amazing. I worry that a lot of otherwise brilliant developers are going to get blindsided by this stuff. The current models are impressive in strong, quantifiable ways. They are only going to become more powerful from this point. Consider the current state of affairs: ChatGPT supports a 4K context size. Leaked foundry pricing indicates models that can handle 32K context size. 32K tokens is enough for your entire brand manual or several days worth of call center transcripts. Many products could have the most important parts of their codebase completely loaded into just the prompt. I would say you should at least try the OpenAI playground (or equivalent technology) to understand what is possible right now. I had no clue where we were at until ~3 weeks ago. I wouldn't wait until 2024 on this one anymore. |
|