I am possibly being scammed by my ex… through Apple Pay?

Sooo since the beginning of the year, I’ve had over $500 taken from different food delivery services. None of them match my previous orders… anyways I got my money back from the bank, but I suspected that my ex (who I knew to try to scam people) might’ve taken a picture of my card or something…. So I got a new one last week, but yesterday I noticed a charge from skip the dishes (not made by me or from my account)… so I got my card cancelled again. But I’ve been thinking a lot

I remember trading phones with him sometime last year…. I took my SIM card out and did the basic iPhone transfer/restart routine. But is there any way he could still get access to my apple wallet?? I can’t think of another possible way for someone to get my new card info…

Any advice is greatly appreciated!

Side note: after contacting Uber eats due to a transaction I never made, they let me know the payment was made from an account with my ex’s name. (Other delivery services would not give me this info). This is why I believe he had something to do with the whole thing

Edit: just found out from skip the dishes the food was delivered to his address. But I still don’t understand how he could’ve used my card