Yes, at this point I guess you'd have to just visit your bank branch to conduct transactions, or perhaps phone banking.

I remember once when my bank didn't trust me enough to even have a debit/ATM card and forced me to go into the branch and queue up and show ID just to get my own money out of my account.