As you’ve credited the invoice, you can either leave it as it is (the overall effect is zero), or you could delete both the invoice and the credit note.
Generally, if the client has seen the invoice, it may be better to credit the invoice rather than delete it. In this case, don’t forget to send them a credit note too so they know they don’t owe you anything