Try following the steps below
Go to settings-- apps and select Samsung pay and from there clear data. Then reinstall the Samsung pay app, and then you will be able to remove accounts or wallets.
If the issue still doesn't get resolved then contact the customer care