[orenmazor]

I'm really interested in doing more machine learning work (my current projects, as interesting as they are, dont really require it).

I've done a few weirdo projects with NLTK, tho, and its great fun. By stream hacking do you mean offloading learning sets (active or initial) and that heavy overhead into the "cloud", or am I misunderstanding the terminology?

[hmason]

In most data analysis work, we assume that the data resides in some database and that you have the luxury of iterating over that data as many times as you like to get to a final result.

The challenge with stream analysis is that you are dealing with a continuous stream of data where you can see each element of the stream only one time and must still be able to cluster/classify/analyze it. There are still few algorithms and tools designed explicitly for that purpose.