Buying bitcoins in NZD couldn't be simpler. Simply fill out the form and deposit the money and the bitcoins will be sent through to your address as soon as it clears.
site link: http://buybitcoin.co.nz/
Choose carefully any service that store and manage funds for you. Very few Bitcoin businesses offer enough insurances to be used to store money securely like a bank at this point.