We're using both Ember and Backbone here at Square. Backbone has proven useful for small apps (https://squareup.com/retail) while Ember is an effective replacement for Rails when it's backed by a good JSON api.
What do you build your JSON api with? I've been using rails against large javascript applications. It seems like ember.js is a good match against rails (especially with https://github.com/emberjs/data)