Zero Momentum

I’m playing as a level 18 rogue and I can’t seem to build up enough momentum for even a single ability use in most fights. I favor the bow, using aimed charged attacks but I can’t find any items or skills that might be debuffing momentum buildup. Didn’t bother me that much (other than cool ability fomo) until I had to fight a large enemy in which hand to hand doesn’t get you far. Maybe I’m too aggressive and taking damage too often but it seems really punishing on my momentum bar.

Any thoughts?