And it is a flawed idea. My right to bear arms hurts no one. If others abuse their right to bear arms and violate the rights of others, they are the ones hurting people and they should be punished. My right to bear arms does not give me the right to shoot someone without a valid reason, i.e. defending my life or someone else's.
And there is no need to put right in quotes. Self-defense is the most fundamental human right. Without it, none of the others mean much. And unlike many in our society, I consider it a responsibility. Law enforcement, as the courts have held, have no responsibility to protect me. From Bowers v. DeVito (1982):
Dirk...there is no constitutional right to be protected by the state against being murdered by criminals or madmen. It is monstrous if the state fails to protect its residents against such predators but it does not violate the due process clause of the Fourteenth Amendment or, we suppose, any other provision of the Constitution. The Constitution is a charter of negative liberties; it tells the state to let people alone; it does not require the federal government or the state to provide services, even so elementary a service as maintaining law and order.