Motive behind penguin doing what he did at the end ...

He looks like he was tearing up while he did it to him ..was he saying that having a soft spot for Vic would not be good for him ? That keeping Vic around would hurt him in the long run ? And if so in what way ?