Characters taking ages to load - any fixes?

Every match I get in, after selecting my hero, it takes ages for everyone's characters to load. Is there something I can do about it? The game is already installed on a very good SSD so that shouldn't be a problem.