The ‘VAT Number’ option on the invoice should be showing your VAT number rather than your clients.
Can I confirm that the VAT number shown is yours?
[Edit]
I just wanted to add to this that it does seem that a client’s VAT number will automatically appear here too, if the client is registered in another EC member state. Please see the post below for more info: