Number of Objects - YOLO

Relatively new to CV and am experimenting with the YOLO model. Would the number of boxes in an image impact the performance (inference time) of the model. Let’s say we are comparing processing time for an image with 50 objects versus an image with 2 objects.