Can I have goods delivered to a UK address without paying VAT?

No, VAT is charged on all deliveries made to an address in the UK, even if you intend to take them out of the country.