Asked to remove VAT from invoice

Hi all, I have a small VAT registered business providing video production. I've recently been approached for work by a bank/fintech - a household name and provided a quote with the VAT and my VAT number. My contact at the client has since sent me their VAT number (which i've checked and they're registered of course) but then also stated "The VAT exemption number is for the VAT to be exempt (i.e., 0%) when working with UK businesses. Let me know if that's not the case." My understanding is that I should still be charging the VAT regardless of their VAT number as my product/service is not VAT exempt? This isn't a member of their accounts team so its possible they're confused but it's also entirely possible this is just something i've not come across yet as I am relatively new to running a business.

Hi, If your supplies are taxable and you are VAT registered then you would need to charge VAT . Thank you.