Hacker News new | ask | show | jobs
by ravibhatt 4464 days ago
Well, the world does not move on ideal conditions. I have used AWS and Azure extensively. My use case has been mainly around hadoop ecosystem. Here is what happens on azure(HDInsights Specifically):

You have a cluster running, that does some work at certain times in a day. Out of the blue, Several machine would be "re-imaged" and that means it would delete all the logs, working directories etc.Its like a snapshot restore. So when this happens, you have lost any custom changes you had done on the cluster. You lose any 3rd party jars you had placed.

Those machines, join back your cluster and your jobs would no longer run because of missing jars Unless you program to download all files on every reboot.

Most important thing though is lack of prior notifications. I have had cases when a "re-image" happend when my CPU was 100% utilised and my RAM was used 90%. So my box was working on something and azure decided to apply a patch!!

As per frequency, its once every two weeks, sometimes more.