Cuman and bandit camp respawn?

I’ve read mixed things about how these camps respawn. So far I only had one guy respawn at an old bandit camp I cleared out for Bernard. Anybody know the timer on when these camps respawn? And I also read that completing the quest to kill their leader turns the respawn of the camp off. Is that true? Any insight would be much appreciated