I have a theory on this season, i like it but i think they are rushing it to save money, in the 1st 4 episodes 2 major characters die, they introduce the phone already and there is not enough people to hold the prison, who thinks they will just give up the prison win the Gov comes by? Let's think on his, Rick and Daryl and Glen will have to do most of the work now, they have a baby with them and let's be real, no amount runs to the city will feed it for long, unless Michonne and Andrea get there i see them giving up the prison fast. They cutting out certain elements of the comic and almost making the Gov a good guy who just went crazy. He is way better than he is in the comic, now i admit the comic version made the situation scary from the jump and it worked. This version, unless he does something dramatic, i think he will be lame duck status.
On the TV show we meet the Governor as he is going through his insanity phase, on the comics we meet him fully insane.
Also, I think Mazzara has mentioned that Season 3 and 4 will take place in the prison so I can see them being able to hold up in there for a while. The Governor doesn't have too many men either if you look at who went with him to take out the soldiers. I would say they will be okay to guard the prison even though they are a little short handed. Andrea, Rick and Daryl are great shots, throw in Carl, Axel and Oscar and the odds even out.