What is with the Governor killing people for no reason? He wants to clear out the prison for no reason?!
They have ruined his character. His motivations seem pointless and out of place. The rape would have solidified what a monster he was but since they didn't (or couldn't) go through with it they creating odd scenarios for him to come across a villain.