[latchkey]

I recently tried out Joyent SmartOS for a NodeJS consulting gig I'm doing. After about 30 seconds, I killed the vm and switched to Ubuntu 12 server.

I don't care if SmartOS is 'faster' or has dtrace. The fact that it is missing basic things like top (no prstat isn't anything close to top) and 'standard' things like upstart made me want to run for the hills. The Joyent wiki documentation on SmartOS is abysmal at best. Even the pkgsrc repository system feels ancient and pales in comparison to what apt is. I have no desire to spend time re-inventing basic tools that linux has had for ages.

The image version of SmartOS w/ NodeJS isn't up-to-date with the latest Node release and it starts up MongoDB by default. While this may be good for just getting things running quickly, what happens if I don't want Mongo running at all? Generate my own images? No thanks.

I know, lots of hate... but it isn't all bad. Joyent as a cloud platform is great. Basic ab testing against NodeJS had me serving 9900 concurrent connections without any issues on their least expensive vm (which runs on a blazing fast network at 10gb/s). We were on Rackspace before and with a network limited to 20Mbps/s (at the lowest tier) we just couldn't get the throughput we needed.

tl;dr: SmartOS is a train wreck. Don't waste your time. Joyent as a platform is great. Why bother with EC2 when Joyent is faster and less expensive?

[bcantrill]

For whatever it's worth, we are very actively working to make SmartOS a more hospitable environment to those coming from other systems. I'm not sure if you're interested in the details here (after all, it sounds like you might have spent longer on the HN comment than on the "30 seconds" with SmartOS), but if you provision the default base smartos64 image (currently version 1.6.3), "top" is available via pkgsrc ("pkgin in top"). Not only that, but due to popular demand, we've also ported "htop" to SmartOS ("pkgin in htop"). In terms of node.js version, I think what you're referring to is the node found in the base platform (/usr/bin/node), not the node available via pkgsrc (which will appear as /opt/local/bin/node). This is definitely a point of confusion, and we've rectified it in the next version of our software by not having the node version that we use in the base platform be visible to SmartMachines (that is, there isn't a /usr/bin/node).

More generally, we're definitely committed to making SmartOS the best environment for the modern cloud; I'm sorry that your experience was frustrating, and if you have any additional concrete feedback on what you'd like to see improved, we're all ears. And finally, I know you said that you "don't care" about DTrace, but I just can't help my (biased) self; if you're developing a node.js app, you really should check out some of the things that SmartOS can uniquely do with respect to node:

http://dtrace.org/blogs/dap/2012/04/25/profiling-node-js/

http://dtrace.org/blogs/bmc/2012/05/05/debugging-node-js-mem...

[latchkey]

As a new customer, I feel like Joyent needs to focus on simplifying things quite a bit. I want to run NodeJS on a server. I install the aptly titled 'SmartMachine Node.js' product and expect it to be the right version and the basic tools installed to get the job done. Instead, I get this morass of oh, you didn't install the right machine or oh, node is in some other directory now. Can you see how that might be distracting?

Sure, I didn't spend a lot of time with it, why should I? I saw that it was missing a great deal of basic things out of the box. I decided quickly to not waste my time learning more esoteric stuff that is only useful if I stick with Joyent and SmartOS.

You are an absolute genius for creating dtrace and it is nice to have but certainly isn't a necessity for most applications. Your example is voxer which is a total edge case since they've been pushing the node envelope since day one.

In the end, the reality is that SmartOS doesn't feel modern at all, it feels like Windows98. Actually, it feels like SunOS back when I had pizza boxes under my desk 15 years ago. I could spend time giving you tons of (free) feedback about what's wrong with SmartOS or I could just use Ubuntu and move on.

9900+ concurrent connections on a $22/mo Ubuntu box is 'good enough' for me.

[4ad]

The things you are complaining about -- top vs. prstat, dtrace, upstart vs. smf, clear and comprehensive documentation vs. man pages written in an afternoon or blog posts on the internet, apt vs. ips -- these are things that are objectively better on Solaris in a quantifiable way. If they make you feel like you're working with Windows 98, I don't think the problem is with the tools, but somewhere else.

A few days ago there was an article about Linux monoculture. It's even worse than that, it's an Ubuntu monoculture.

[sojacques]

Well, you said Solaris, not SmartOS.

If you really believe there is more information in SmartOS' wiki than in man pages & other proper documentation available about Linux, I don't think the problem is with the Linux monoculture, but somewhere else.

[4ad]

SmartOS is Solaris. All documentation about Solaris is pertinent to SmartOS.

[4ad]

You're complaining that SmartOS doesn't ship with inferior technology? That's not a valid criticism. Perhaps a valid criticism might be that Joyent doesn't make it clear enough why prstat, DTrace and SMF are superior to Linux alternatives, and where would you find documentation for all these things. It's understandable that you searched the SmartOS wiki, but the Oracle Solaris documentation would have been better if you were not familiar with Solaris.

Joyent has to make the experience better by streamlining documentation, not by compromising its core values that make SmartOS great. The quality of the Solaris documentation is great, it's just not organized how Linux people expect it to be and they don't know where to find it.

[ryankask]

We used SmartOS (or its predecessor) for 3+ years. The experience was overall very positive and performance was great. Joyent's reliability is outstanding. Sure, some of our software was dated but everything worked.

The bigger issue is Joyent's product lifespans. We've had to migrate our servers twice in that three or so years. Because of that, I moved to a different cloud provider. I don't know if I can expect better.

The only outage I can recall was recently when they began the process of EOLing the current product we use from them.

[james33]

You can very easily install whatever version of Node.js you want using this bash script: https://gist.github.com/a0d40f1ff1679ed582a5. Also, MongoDB isn't even installed by default on the Node.js instance.

[latchkey]

http://wiki.joyent.com/wiki/display/jpc2/SmartMachine+Node.j... v1.4.0 "This version now runs MongoDB by default"

As for your bash script... I stopped compiling binaries ages ago, why would I want to start again when I can just use Ubuntu and the official NodeJS PPA?