I frequently carry a Colt SAA, 5 1/2", .45. I have never felt under gunned. I practice, CAS, a lot.
If you run up against a squad of Marine Recon or Army Special forces then you will be out gunned. Against street punks you'll be fine. BTW, those Marines or Soldiers will kill you no matter what you're carrying.