At what age do scents become less bad?

My husband loves cologne and scented candles. We have a 5 month old. At what point is it more ok to go back to them?