[coddle-hark]

I see this sentiment a lot, that attempts at general AI are improving at an exponential pace, but it’s just not true. Hell, we can’t even agree what consciousness is, let alone how to measure it. The truth is we don’t have a clue how far away we are from true AI, we have literally zero reliable indicators to gauge our progress. It’s not like we have a Moore’s law for consciousness or something like that.

I agree that we should think about these questions ahead of time and not wait around until general AI is upon us though.

[kamray23]

It's not a "sentiment", really, it's a provable fact from history. Human technology improves exponentially, that much is true. AI has continued to improve at a similar pace, if only because of transistor counts. We have no way of knowing however, where we are on the curve right now. So it's better to just play it safe and start thinking about it now.