Disable client access to account

Is there a way you can prevent a customer from ‘logging’ in to see invoices and statements if they have previously done so? I cannot see any option under the client like ‘allow client access’ but I may be looking in the wrong place.

Removing the contact record will be sufficient to prevent them from logging in. Currently this is the only way to revoke access.