Sizing Software Testing Efforts

TCQAA Round Table Discussion - November 11th 1999

Topic: Web / E-Commerce Testing

Moderator: Barbara Ruf

Web testing:

Testing via a web browser
Internet or intranet or both
An application used in e-commerce
Web as a front-end presentation layer

Testing tasks that are the Same:

Writing test plans and test cases
Requirements management
Bug tracking
Results reporting
Automation (GUI and Functionality)

Testing tasks that are Different:

"Web-time" development – faster turnaround time
Test to developer ration
Rapidly changing environment
Web browser version
Certified vs. supported platforms
Plug ins
Load/stress test focus
Cookied vs. non-cookied users
Fraud detection
Hacker mentality
Technical testing requires "developers" over "testers"
First to market competition

Tools that help:

Mercury Interactive has Xrunner and LoadRunner
Rational has Performance Studio, LoadTest and TeamTest. Rational SiteCheck is a Rational product you can use to manage your Intranet or World Wide Web site.
Sun Test has JAVASTAR
Shareware off the web
Languages, i.e. Perl

Greatest Challenges:

Timeframes and deadlines
"Hotshot" developers
Requires a flexible RAD environment
Competition – "keeping up with the Joneses"

Resources:

Support vs certify article:
http://www.datamation.com/apdev/9904hayes1.html

other interesting datamation articles (you can easily subscribe if you want - it is a free, email newsletter):
http://www.datamation.com/apdev/9911levin1.html (web stress testing)
http://www.datamation.com/apdev/09hayes_980901.html (this one covers tester/developer ratios)
http://www.datamation.com/apdev/9910hayes1.html (requirements)
http://www.datamation.com/apdev/9910meth1.html (developing on"internet time")
http://www.crl.com/~zallar/testing.html (interesting testing links)

Books:

"Competing on Internet Time: Lessons from Netscape and its Battle with Microsoft"
Michael Cusumano and David B.Yoffie, ISBN 0-684-85319-1

"Microsoft Secrets: How the World's Most Powerful Software Company Creates Technology, Shapes Markets, and Manages People"
Michael Cusumano, ISBN 0-028-74048-3

"The Craft of Software Testing"
Brian Marick, see his links at http://www.rstcorp.com/marick/faqs/tools.htm and http://www.io.com/~wazmo/qa.html and http://www.io.com/.

"The Automated Testing Handbook:
Linda Hayes

"Visual Test 6 Bible"
Thomas Arnold

"Automated Software Testing: Introduction, Management, and Performance"
Elfriede Dustin, Jeff Rashka, and John Paul

"Software Test Automation"
Mark Fewster and Dorothy Graham