
Originally Posted by
Maggwin
Sorry going to have to bite on this "it's all the QA's Fault" meme that runs through "interweb" forums. Guess what? If dev's didn't add bugs we'd have perfect games
As an experienced software tester all we can do is highlight bugs, issues and risks to stakeholders. QA's are not (and have never been and should never be) in the position to say NO we can't deploy this code, no matter what you are told by various 'Experts' on this and any other forum.
Please review and fully understand this, from one of the best the software test industry has to offer, before you decide to "blame" the QA for not testing enough. Seriously if you are into software testing in anyway take the RST course.
http://www.developsense.com/blog/201...ance-business/
and
http://www.developsense.com/blog/200...g-vs-checking/
Seconded. I have been doing beta testing for some 20 years now, off and on, for a number of software developers that ranged from small shops to the biggest of the big. Folk around here really get on my nerves with their rants that don't understand testing nor QA.
At a small shop, QA is a small team. Their machines are standardized. You could envision them as the very first group of Phase I testing in the pharma world. Very select group that does a first pass of safety and sanity checking and data collection. This group will never be a representative sample of the live users.
To supplement that, shops often get a group of 'regular Joes' to help out. You could envision them as the second group of Phase I testing in the pharma world. These people expose your software to a small subset of live machines. Very select group that does a second pass of safety and sanity checking and data collection. This group is also never going to be a representative sample of live users.
Now we get to closed alphas and closed betas. A closed alpha will be a select group of testers, and may be larger than the group mentioned above. A closed beta will be a larger group than mentioned above. These people expose your software to a small subset of live machines, but that subset is now larger and may be a representative sample; but if so, only by chance. These people can be envisioned as early Phase 2 trials in the pharma world. The most common side effects have a chance to be seen here. Rare ones will not, except by chance.
Some shops run open betas. This group will be much larger than those mentioned previously. The group is still a selected group; but now it is more of a self-selected group. Your software is now exposed to a much wider world of machines and varying software/hardware states. This group has a good chance to be a representative sample of your users; but if so, only by chance. These people can be envisioned as Phase 2/ Phase 3 trials in the pharma world. You have a good handle now on the relative frequency of the most common side effects. You now see some of the more rare ones. You still don't have a clue about the rarest and might not have a clue about the rarest effects that are the most serious.
Since all of this is done on already developed systems/products, you really can't change much; but you have given early information that help speed fault diagnosis later on. You are also a focus group that can give some feedback about customer acceptance, but the value is going to be limited because of the selected (meaning that the sample is not representative) nature of the focus group.
Now you've hit the ship date. Your product is exposed to any and every body. Stuff happens. You know stuff will happen. You have no way to know who will or will not be adversely impacted. Folk will, who've never created anything or worked within the system that creates these things, complain and call you incompetent. You do your best to shrug off the most vile of these statements and do what you can to minimize any adverse impacts. There will always be adverse impacts.
"No sadder words of tongue or pen are the words: 'Might have been'." -- John Greenleaf Whittier
"Do or do not. There is no try." -- Yoda
On planet Earth, there is a try.
Indeed, in a world and life full of change, the only constant is human nature (A is A, after all :P).
We old vets need to keep in mind those who come after us.