Bandits

I started a game and set it up so there are no random raids, but bandits are still stealing my resources?