Does it hurt to end a relationship with someone that you have feelings for?

Of course it does, but doing it for the "right" reasons, which you described are good, valid reasons. He's wishy-washy, dilly-dallys around, unpredictable and not reliable. You can't deal with that because you know how rude and frustrating that is. So, knowing you made a good, healthy choice for yourself will ease your pain and also give you good incentive to be very choosy next time and look for these things before you actually begin an exclusive relationship. Good luck... you will wish you did this a long time ago.