Contrary to the other two replies, yes, they are paid interest (it's a reverse of the standard repo where they borrow money from the Fed and pay the interest)
Banks don't like holding cash (because it doesn't belong to them, and could be withdrawn at any time). So it's actually the opposite: they pay for the privilege of not having to hold onto that cash.