Would leaving my son with a babysitter for about 2 hours a week be selfish or good for him?

It's not at all selfish! I think it would be good for him. Make sure that the babysitter knows though that he may have separation anxiety and he may be very upset the first few times she watches him.