I never been to Panama, but have been to Colombia and CR, and I'd have to say I preferred the women in Colombia by a huge margin, while I think the atmosphere and people in Costa Rica are more welcoming & laid back. As far as women go, it's not even remotely close between them, Colombia is basically a world power when it comes to females, you'll find pretty women in Costa Rica but you'll see more jaw dropping women in Colombia.
They both have incredible beaches, I'd give the edge to Costa Rica, especially if you're not hitting up the Pacific side of Colombia which I was told had the best beaches in Colombia. Costa Rica is far more chill, women aren't as bad but you can still find pretty chicks. I stayed in a Hostel while I was there, ended up getting a private room with this Bajan/Trini chick from Canada while I was there so I didn't fukk with any Costa Rican women. I will say in Colombia to fukk with local women who weren't looking for tourists I needed a friend who lived there to introduce me to his female friends, but you'll find a lot of chicks who'll fukk with you just cause you're American.
Where in Colombia would you be going? I'd assume the Caribbean coast of Colombia, Cartagena / Barranquilla / Santa Marta, right?