Use Game Engine to do animation then v2v to make it cinematic/photo-realistic?

I've been failing to find the best way to do this so figure other people might be interested in finding the answer too.

Generally I'm wanting to use my UE5 skills/assets to make shorts and then run them through ComfyUI to turn them into realistic looking video. Ideally I'd like to be able to prompt the style that the UE5 input video gets turned into. Like if I use a red and blue manequin fighting, I could say "Two clowns fighting, cyberpunk cinematography" or "Two cowboys fighting, pixar studios" - that kind of thing.

What workflows are people using for that type of functionality? I would prefer it if the model/workflow could run on a 12GB 3060 but I'm also exploring renting some H100s if the workflow has serious potential.

I've got LTX, Hunyuan, and cosmos locally to mess around with - LTX feels like it would be the closest. Hunyean and Cosmos hate me so far lol