Hi vivacity
If you a Non Established Taxable Business and you are making taxable supplies in the UK then there would have been a requirement to register for VAT upon making your first sale of goods/services in the UK.
If you have made any supplies in the UK then you will need to complete a VAT return and account for these but if you haven't made any sales then you will complete a nil VAT return.
If you are not intending to make any more sales then you can deregister from VAT and you can do this yourself.
Please see the guidance below:
Register for VAT - Cancel your registration.
Thank you.