Does my HSA have to have money in it before I use it to pay a provider?

Yes, this is a personal bank account in your name. Your card is a debit card, not a credit card. Like a checking account, the funds must be in your account before you can pay for an expense.