You feel bad because you betrays him, but something appeared and everything changed. And although this is wrong, you can not change this because you feel it and against that can not do anything. It will be a matter of let go and decides the fate