I applied for a credit card awhile ago, was approved and got the card in the mail. But I never activated or used it. But the bank charged me an annual fee and then past due fees on top of that, and interest.

Are they allowed to do this, if I never activated the account?