So as I understand it, the only thing holding Chaos Dwarfs back is population?

Like not even from just a pure game-only perspective, even in lore i feel like with proper command and enough chaos dwarves they have a pretty damn good chance of kicking everyone's shit in like the chaos warriors of the north.