I wonder if Stripe is planning to launch in New Zealand any time soon - it's very close to Australia :) I'm really keen to stop relying on Paypal for accepting payments.
We are working on New Zealand, but don't have an immediate ETA for an New Zealand beta. Sign up at https://stripe.com/global to be notified when we launch
Whatever you use it will invariably suck in some way. PX is fine, but getting a merchant account sure isn't. All the stripe clones in NZ are balls. Please, Stripe, whatever you're doing to get to NZ, double it!
Using Paypal at the moment, as te_chris said PX pay is decent but requires a merchant account which is expensive and slow to setup. As far as I am aware their aren't any other decent solutions. Kiwipay could be good but at the moment it isn't really suitable for anything more than casual payments.
Aside from merchant account setup, last time I looked (4 years ago), Payment Express worked out to be really expensive when charging in USD. I think it was in part due to merchant account/currency conversion charges by the bank. It was significantly more expensive than Paypal. I don't know if the situation has changed since then.
I know that the only bank that allows international currency transactions is BNZ so they are likely fairly expensive seen as they have an monopoly on it.
I looked at it in some detail but they were a pain to assess. Wouldn't give me any details of the API or feature set unless I created an account... for a non-refundable $200 fee. I pointed out how ridiculous this was, and they said that if I went through their signup process and committed to paying the $200, they would let me look at the documentation without actually paying the fee. It was all so vague and ad-hoc I found it pretty hard to trust whatever might be behind the curtain.
(edit: Looks like fee is now $99, and there's a little more detail on their developers page.)
PX pricing is actually pretty good if you've got high transaction volume. But it's terrible for small biz. Most people I know default to Paypal.
Please Stripe, please come to NZ fast. You've been talking about it for more than a year. I know we must look like smaller-poorer Australia, but I promise there are people here who'd use you!
I think it might be OK for one-off payments, but I couldn't find anything other than manual setup of recurring payments on their web site. Price wise it's comparable to Paypal though. The trouble for me is that it doesn't integrate with my shopping cart (getdpd.com).