Depends on your lifestyle. You can live comfortably with a small amount, but if you have personal preferences (like having a smartphone, Macbook air, skiing in winter, and a good car) the location won't really matter much.
Have you lived there? It's not that expensive. Primary costs would be rentals. And they fall exponentially as you move away from Nariman Point (city center)