Ps5 hdr looking worse than it does without?

I recently upgraded to a hdr tv and I noticed that rdr2 looks worse with hdr on than it does without. The whole world just feels darker and muddier with hdr. Does anyone know of a fix to this or is there nothing I can do?