Paper talisman mini game

I'm really struggling with the paper plane talisman mini game. I'm just not quick enough, I've spent weeks doing nothing but mulberry collection and fishing to get this item but it's just too fast. It's frustrating. Is anyone else struggling or do I just need to try and be quicker?