Hi,
You have explained the correct steps to remove a service from the Business Tax Account, but we suggest that you deal with the outstanding amount before you do this.
If this amount relates to corporation tax, you can discuss this with us by calling 0300 200 3410.
If the amount relates to another tax, you can find the relevant contact details at:
Contact HM Revenue & Customs.
If you experience any technical problems trying to remove the service from your account, you can contact our online helpdesk on 0300 200 3600.
Thankyou.