[daveguy]

> because it is able to improve itself by learning on his own mistakes, soon after he hits the AGI mark, he will surpass that and become ASI (Artificial Super Intelligence).

I was with you until this point. You have a great description of why ANI is not AGI, but this AGI => ASI is just hand waving.

An AGI will have some of the same issues to deal with:

1) opportunity cost. yes, it will have more time because it doesn't sleep. Although maybe it will find that spending 1/3 of its time/resources cleaning out the cobwebs is optimal. Regardless it will have to spend resources (including time) on some things rather than others. The leap from general adaptability to perfect selection of tasks is likely just as large if not larger than the leap from ANI to AGI.

2) Some problems are just plain hard. There are algorithms for learning optimal results -- even brute force. The problem is they are too complex for a realistic fast solution. Just because an algorithm becomes as adaptable as a human doesn't mean that computational complexity is reduced. Therefore, either the AGI will consume massive resources to get a single optimal answer or they will be fallible just like humans.

When we get AGI, that just means we will have adaptable general algorithms, they will still have to learn and they will still be susceptible to restricted resources. In other words AGI does not imply ASI.