I understand why they feel like they need to do what they need to do. They get there and they're just fish in a barrel, more or less. Anyone could plow through that fence, or show up with better guns/aim, or climb the fence, or set the houses on fire, or follow them back, or take it as their own. I understand why those other people don't care, but Rick and the gang are going to have to make it rough. Reality has to hit the community sooner or later. They aren't in la-la land. The zombies aren't fun things you tie on a tree, or a game that you can access by walking over to the other side of a fence. Unfortunately, Rick and them are going to have to do something.
How anxious would you be if you had been through everything that they had, and you're in a little community with a huge fence that is easily scalable, and no one is watching the perimeter, and the best defenses you've come across are pretty boys with a false sense of danger? The leader of their group wanted people from the outside to come in, and for better or for worse they found Rick's group.
That's the problem with this new group. Are they this naively lucky? Or are they this diabolically evil?
With all of the story lines developing (home wreckers, CAREERS, families, new colleagues, psych issues), this show is probably going to go into Zombie Soap Opera for at least a little while.