You can apply to deregister via your Business Tax Account on GOV.UK. Or you can complete a VAT7.
However, you are likely to have to submit at least one VAT return.
If you'd like to discuss this in further detail, please contact HMRC:
VAT: general enquiries