I think nearly everyone is miserable whether they kill or not. But being a pacifist in that world is not only a danger to yourself but to everyone around you. Morgan's mind is so fukked up that he could walk in on dudes raping and killing women and he would try to talk to the guys, then would let them get up and walk away. Even if they said "hey we are gonna come back with 20 more if you let us leave"
Morgan would say "Come on young man, it doesn't have to be like this. Just walk away..."
Morgan would help everyone if he just left Alexandria. His actions so far have only hurt his people.