xxxxxxx x
xxxxxxxxxxxx xx
xxxxxxxxxxxx xxxx
xxxxxxxxx xxxxx
xxxxxxxx xxxxx
xxxxxxxx xxxxx xxx x
xxxxxx xxxxx xxxxxxx xx
xx xxx xxxxxxxxx xxx
x xxxxxxxxxx xxxx
xxxxxx xxxxx
xx xxxxxx xxxxxx
xx xxx xxxxxx xxxxxxx
xxx xxxxx xxxxxx xxxxxxx
xxxx xxxxxx xxxxxx xxxxxxx
xxxx xxxxxxx xxxxxxx
xxx xxxxxxxx xxxxxxx
xxx xx xxxxxxxx xxxxxxx
xxx xxxxxxxx xxxxxxx
xx xxxxxxxx xxxxxxxxx
xx xxxxxxxxx xxxxxxx
xxxxxxxxx xx xxxxx
xxxxxxx xxxxxxxxx xxx xxxxx
xxxxxxxxxxxxxxxxxxxxxxxx xxxx xxxx
xxxxxxxxxxxxxxxxxxxxxxxx xxxxx xxxx
xxxxxxxxxxxxxxxxxxxx xxxxxx xxxx
xx xxxxxxxx xxxxxx xxxx
xxxxxx xxxxx
xxxxxx xxxxx
xxxxxxxxxxxxxxx xxxxxxxxxxxxxxxxx
xxxxxxxxxxxxxxx xxxxxxxxxxxxxxxx
+===================================================+
+===================================================+
+======= Testing Techniques Newsletter (TTN) =======+
+======= ON-LINE EDITION =======+
+======= April 1994 =======+
+===================================================+
+===================================================+
TESTING TECHNIQUES NEWSLETTER (TTN) is E-mailed on a monthly basis to
support the Software Research, Inc. (SR) community and to provide infor-
mation of general use to the testing community.
(c) Copyright Software Research, Inc. 1994. Permission to copy and/or
re-distribute is hereby granted to any recipient of the TTN On-Line so
long as the document/file is kept intact and this copyright statement
appears with it.
TRADEMARKS: STW/Regression, CAPBAK, SMARTS, Software TestWorks, STW, X11
Virtual Display System, X11virtual, and the SR logo are trademarks of
Software Research, Inc. All other systems are either trademarks or
registered trademarks of their respective companies.
========================================================================
INSIDE THIS ISSUE:
o STW/Regression's Direction
o The STW Insider: X11virtual
o 7th International Software Quality Week (QW '94)
o 1st IFIP/SQI International Conference (Asia-Pacific)
on Software Quality and Production
o 1st Annual Object Applications Awards at Object World Germany `94
o Technical Articles of Interest
o Calendar of Events
o TTN Submittal Policy
o TTN Subscription Information
========================================================================
---------------->> STW/REGRESSION's DIRECTION <<----------------
========================================================================
This month marks the start of the second business quarter and with it
comes several technical enhancements on the Software TestWorks (STW)
tool suite. The following is an initial preview of upcoming enhance-
ments:
*---> CAPBAK/X Widget Testing Mode
The new widget or object testing mode will complete an architectural
development plan for CAPBAK/X.
The true-time testing mode, the initial mode currently supported by
CAPBAK/X, replays keyboard and mouse activity exactly as recorded by the
tester and provides bitmap and character verification. Playback timing
can either reflect actual recording time or be adjusted to different
values.
Bitmap verification automatically compares images captured during a
recording session with the actual images at playback. Character recog-
nition verification determines a successful test based on the actual
values. It extracts the values from bitmap images using the OCR tech-
nology, translating them into ASCII characters (regardless of font or
background color), and then compares the expected and actual values for
differences.
The true-time testing mode accommodates minor application changes to the
graphical user interface (GUI) through character string synchronization.
While this mode can recognize bitmap images and manage font, type-size
and location alterations, it cannot handle character string modifica-
tions (such as "Quit" being changed to "Exit") within the user inter-
face.
The widget testing mode, on the other hand, can handle modifications to
the application under test's (AUT) user interface because it directly
queries the internals of an application's GUI, sometimes referred to as
GUI objects. Examples of an application's GUI objects include push but-
tons, pull-down menus, list selections, and text widgets.
Widget testing is excellent for testing portability between platforms.
Because widget technology operates directly with the objects, test
scripts are not effected by environment changes to the AUT, and, there-
fore, the test scripts are portable between platforms. The multitude of
objects included in a typical application's GUI can automatically be
added, modified or deleted in a test script. As a result, test re-
recording can often be avoided.
While widget technology will not verify GUI correctness, it will confirm
that the application's engine ran successfully. With the widget tech-
nology, tests might pass despite conditions in which a user could not
operate the application interface (such as a command button being hidden
behind a window). Therefore, even if the widget testing mode has been
run, it is still important to perform user-level testing, either manu-
ally or with the true-time testing mode. CAPBAK/X's enhanced architec-
ture will provide the capability to toggle between true-time and widget
testing modes during a recording session.
*---> C-Language Implementation with Interpreter for Test Scripting
The SMARTS and CAPBAK products will use a C-language interpreter to
further facilitate test recording and scripting. The C-language inter-
preter will provide full language support with the exception of a few C
constructs (such as structures and pointer-to-pointers), which will be
omitted from SMARTS' Automated Test Script (ATS). All events and
actions will be recorded as C function calls in CAPBAK.
The benefits to using a C-language interpreter are substantial:
o Users already familiar with C need not learn a new or vendor-
proprietary language.
o Conditional statements, loops and variables can be added to previ-
ously recorded tests, creating a more sophisticated test program.
o Language structure allows functions to be re-used.
Implementation of the C-language interpreter in SMARTS/X, SMARTS/MSW and
CAPBAK/X will be completed by the end this quarter. The implementation
for CAPBAK/MSW is currently shipping.
========================================================================
--------------->> THE STW INSIDER: X11virtual <<----------------
========================================================================
The STW INSIDER assists our customers in the use of Software TestWorks'
(STW) tools, by providing information on efficient usage, error
avoidance, and workaround techniques.
The featured topic this month is the X11 Virtual Display System
(X11virtual), Software Research's (SR) load generation testing system.
X11virtual provides the user with the capability to simulate multiple
user sessions from a single machine for purposes of load generation,
performance assessment, and multiple-test execution.
Because of its general applicability, SR has been offering the
X11virtual software *free* to all requesters between March 15, 1994 and
April 30, 1994. (There is a nominal $45 media and handling charge.)
The following usage techniques are provided in response to customer
questions regarding X11virtual:
Q. Can non-standard server characteristics be configured?
A. X11virtual can accommodate simulations of monochrome, color or
gray-scale monitors, selectable with an invocation switch. The
default is a color display.
Although X11virtual defaults to the standard screen size of 1280 x
1024, X11virtual will accept the dimensions of the current screen
from the command line. One can, in effect, simulate any size screen
during test playback.
In a typical application, X11virtual is used with a test
capture/playback system to recreate user inputs. If desired, the
application can be programmed to accept inputs from a "real"
display.
Q. Can scripts and GUI applications be run in the background?
A. X11virtual includes a complete copy of X11, allowing scripts and
graphical user interface (GUI) applications to be run in the back-
ground. SR modified the X11R5 server so that it simulates a display
in RAM. This virtual X-Server behaves just like X11R5, except it is
not tied to any physical hardware.
A. How are virtual displays monitored?
Q. With X11virtual, multiple virtual displays can easily be monitored
and controlled. X11virtual provides a monitor for each virtual
display.
At any time, an entire screen or a top (or focus) window can be
selected and viewed from one or more virtual displays.
The *free* X11virtual offer expires April 30, 1994. To request informa-
tion or obtain a registration form for the X11 Virtual Display System,
contact:
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
-= Software Research, Inc. =-
=-= ATTN: X11virtual Registration =-=
=-= 901 Minnesota Street =-=
=-= San Francisco, CA 94107 USA USA =-=
=-= =-=
=-= Phone: (415) 550-3020 FAX: (415) 550-3030 =-=
=-= E-mail: virtual@soft.com =-=
-= General Information: info@soft.com =-
=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-=-
========================================================================
---- 7th INTERNATIONAL SOFTWARE QUALITY WEEK ----
---- ----
---- Conference Theme: MAINTAINING COMPETITIVENESS ----
---- May 17-20, 1994 ----
---- The Sheraton Palace Hotel, San Francisco, California ----
---- ----
========================================================================
--- CONFERENCE THEME ---
In today's marketplace, organizations are faced with the difficult chal-
lenge of developing and delivering complex software systems, while con-
tinually improving predictability and reducing the cycle time between
releases. Companies that can master quality and productivity issues
will dominate their markets into the next century. The theme for the
7th International Software Quality Week (QW'94), "Maintaining Competi-
tiveness", reflects that goal by focusing on advances in software test
technology, quality control, risk management, software safety, and test
automation techniques. The goal is to help organizations implement
manageable, well-defined, repeatable quality processes.
--- CONFERENCE STRUCTURE ---
QW'94 has a pre-conference tutorial day and a complete three-day general
conference with keynote sessions, mini-tutorials, and regular technical
papers tracks. There are two special debates, a vendors' presentation
track, and an expanded two-day vendor exhibit featuring top suppliers of
Computer Aided Software Test (CAST) products.
QW'94 speakers include industry experts, academics and experienced prac-
titioners in QA/QC/Testing to provide the methodologies and advanced
automated software test methods that promise major advances in system
quality and reliability. Key speakers and their QW'94's topics are:
* Dr. Boris Beizer (ANALYSIS) "On Being Competitive"
* Mr. Bill Bently (Miles) "Capturing Requirements"
* Mr. Robert Binder (Independent Consultant) "Testing Object-Oriented
Systems: State of the Art, State of the Practice"
* Dr. Leo Egan (Egan Systems) "Simplifying ISO 9000-3"
* Mr. Tom Gilb (Independent Consultant) "Software Inspections"
* Dr. Warren Harrison (Univ. of Oregon) and Dr. Paul Oman (Univ. of
Idaho) "Using Metrics to Guide Testing Software QA"
* Dr. Herb Hecht (SoHaR) "Software Dependability in Distributed Sys-
tems"
* Mr. Hans-Juergen Kugler (K&M Technologies) "What's on in Europe?
European Software Quality Initiatives"
* Dr. Micheal Mac-an-Airchinnigh (Univ. of Dublin) "Formal Methods,
Requirements and Testing"
* Dr. Monika Muellerburg (GMD) "Why Systematic Testing is Difficult:
The Problem of the Sample"
* Dr. John Musa (Bell Laboratories) "Software Reliability Engineering
Practice"
* Mr. Robert Poston (IDE) and Mr. George Symons (SR) "An Integrated
Solution to Specification-Based Testing"
* Ms. Alka Shah-Jarvis (Charles Schwab) "Applying Software Quality:
ISO 900-3"
* Mr. Shel Siegel (Objective Quality) "Where Are the Software Quality
Leaders and What Are They Doing?"
* Mr. Bill Silver (Software Quality World) "The TQO Software Measure-
ment Paradigm"
* Mr. Nicholas Zvegintzov (Software Maintenance News) "Analysis,
Design, and Verification of Software Change"
QW'94 has one goal: To create an on-going publicly accessible platform
where researchers and Quality Assurance and Software Test Professionals,
as well as users at every level, can communicate and exchange experience
and technology.
--- REGISTRATION ---
For information on the conference or to receive a registration package
E-mail your request to "qw@soft.com", phone SR/Institute at (415) 957-
1441, or FAX SR/Institute at (415) 550-3030.
========================================================================
--- 1ST IFIP/SQI INTERNATIONAL (ASIA-PACIFIC) CONFERENCE ---
--- ON SOFTWARE QUALITY AND PRODUCTIVITY ---
--- (ICSQP `94) ---
--- "THEORY, PRACTICE, EDUCATION, AND TRAINING" ---
--- December 5-7, 1994 ---
--- City Polytechnic of Hong Kong, HONG KONG ---
--- ---
--- --- CALL FOR PARTICIPATION --- ---
========================================================================
--- CONFERENCE OBJECTIVE ---
As the world becomes increasingly dependent on the use of computers, the
need for quality software which can be produced at reasonable cost
increases. Yet the goal of improving software quality and productivity
remains elusive in almost all application areas, including business
oriented applications. Software development is not yet an engineered
practice.
It is now widely recognized that improving software quality and produc-
tivity requires more than just good programming practices. It entails a
whole variety of issues and tasks which encompass the entire process of
software development, from abstract user requirements analysis and
modeling to machine-level coding to the education and training of soft-
ware developers. The focus is now clearly on the entire software pro-
cess instead of on individual, isolated elements of software develop-
ment.
This conference aims to bring together researchers and practitioners who
are interested in the efficient production of quality software, so that
views across a variety of issues may be exchanged and a rich perspective
on quality and productivity may be obtained. In addition, this confer-
ence will bring to the fast growing Asia-Pacific region a much needed
focus on software quality and productivity. It is anticipated that this
conference will become a biennial event.
Papers presented will be published in the conference proceedings by
IFIP. The Conference Program will include plenary sessions featuring
prominent invited speakers.
--- SCOPE ---
The conference welcomes contributions in the areas of theory, practice,
education, and training from (but not restricted to) the following
fields:
- Software process modeling
- Software process improvement
- Software process maturity
- Process assessments
- International standards (e.g. ISO, BS, AS, TQM, etc.)
- Software product quality specification and evaluation
- Software metrics and measurements
- Requirements modeling and analysis
- Software engineering environments
- Software reuse and re-engineering
- Software testing
- Software risk assessment
- Project management
- Productivity tools
- Quality aids
- CASE and workbench tools
- Industrial practices
- Case studies
- Software quality assurance methods and techniques
- Software engineering and software quality
- Quality management issues
- Impact of development methodologies on quality and productivity
- Education and training
- Technology transfer
--- SUBMISSION INFORMATION ---
Submit four copies of the manuscript (maximum of 8 pages) to the Program
Committee Co-Chair.
Submissions should include a separate title page (1 copy) specifying the
title, all authors and their affiliations, abstract (maximum 200 words),
up to 10 keywords, and the address of the contact author, including a
telephone number, FAX number, and E-mail address (if available). The
title page should also be submitted by E-mail (in plain text) or faxed
to the Program Committee Co-Chair to facilitate submission processing.
Dr. Matthew Lee
ICSQP `94 Program Committee Co-Chair
Department of Information Systems
City Polytechnic of Hong Kong
83 Tat Chee Avenue, Kowloon
HONG KONG
Phone: +852 788 7348
FAX: +852 788 8694
E-mail: ismatlee@cphkvx.cphk.hk
Potential contributors are invited to immediately register their inten-
tion to contribute a paper to the conference by E-mailing the Program
Committee Co-Chair.
--- IMPORTANT DATES ---
Registration of intention to submit paper: NOW
Deadline for receipt of papers: May 15, 1994
Notification of acceptance: July 15, 1994
Deadline for camera-ready copies: September 15, 1994
All papers will be submitted to a standard refereeing process. Accepted
papers will be presented in the conference. Papers which are presented
will be published in the Conference Proceedings by IFIP.
========================================================================
-- 1ST ANNUAL OBJECT APPLICATIONS AWARDS AT OBJECT WORLD GERMANY `94 --
-- September 27-29, 1994 --
-- Object World Germany, Conference and Exhibition --
-- Intercontinental Hotel, Frankfurt/Main Germany --
-- --
-- --- CALL FOR PARTICIPATION --- --
========================================================================
OBJECT WORLD GERMANY, to take place September 27-29, 1994 in Frankurt,
Intercontinental Hotel, will present the launch of the first annual
Object Applications Awards for the best end-user applications developed
using Object Technology (OT). The awards are sponsored by the Object
Management Group (OMG) and COMPUTERWOCHE.
Awards will be given out in five categories, specifically to honor user
applications and pioneering implementations of the technology. A dis-
tinguished panel of judges, chaired by Professor Roberto Zicari of the
Johann Wolfgang Goethe University of Frankfurt, will determine the
winners through a nomination process. Nominations must come from user
organizations for internally developed applications not for commercial
sale. Production applications or documented and demonstrable working
prototypes are acceptable.
--- SUBMISSION INFORMATION ---
Entrants to the Object Applications Awards must call for an official
Entry Kit. Entrants will be asked to detail goals of the application,
the approach used, problems encountered, and key benefits realized con-
forming to the one of the categories. All entries must be received by
July 15, 1994.
To request an Entry Kit or further information on the conference, call
or fax:
Object Applications Awards
c/o LogOn Technology Transfer GmbH
Burgweg 14a, D-61476 Kronberg (Ts.)
GERMANY
Phone: +49-6173-2852
FAX: +49-6173-94 04 20
========================================================================
------------->>> TECHNICAL ARTICLES OF INTEREST <<<-------------
========================================================================
The following articles address software engineering or software testing
techniques that may be of interest:
o "Formal Specification of Software", G. Jones, Software Engineering
Technology, April 1994.
o "Continuous Process Improvement for Software: Database Validation
and Cost-Benefit Analyses", L. Hale, Software Engineering Technol-
ogy, April 1994.
o "It's Time for ISO 9000", M. Dawood, Software Engineering Technol-
ogy, April 1994.
o "Testing for the Future", E.F. Miller, G.J. Symons, D.A. Steiner
American Programmer, April 1994.
o "NetBIOS and 802.2 Applications: Problems and Solutions", T. Ellis
and M. McIntyre, O/S Developer, March/April 1994.
o "Rapid Code Evaluation", B. D. Rosenblum, Software Development,
April 1994.
o "Column X: Moving Toward Bug-Free User Interfaces", Alvin Wen, The
SUN Observer, April 1994.
========================================================================
------------------->>> CALENDAR OF EVENTS <<<-------------------
========================================================================
The following is a partial list of upcoming events of interest. ("o"
indicates Software Research will participate in these events.)
o April 26-27, 1994: Automated Software Test and Evaluation
Washington, D.C.
Contact: James Heil (Mitre Corp.)
Phone: 908-389-6719
o May 8-12, 1994: Software Testing Analysis and Review (STAR '94)
Alexandria, Virginia
Contact: Carol Staurt
SQE
Phone: 800-423-8378; FAX: 904-268-0733
+ May 16-17, 1994: ICSE '94
Sarento, ITALY
Contact: Richard Taylor
Phone: 714-856-6429; FAX: 714-856-4056
o May 17-20, 1994: 7th Annual International Software Quality Week
San Francisco, California
Contact: Rita Bral
Software Research Inc.
Phone: 415-550-3020; FAX: 415-550-3030;
E-mail: qw@soft.com
+ June 7-9, 1994: Assessment of Quality Software Development
Washington, D.C.
Contact: Ez Nahouraii
Industry Education Counseling
Phone: 408-265-1960
o June 13-16, 1994: USPDI '94
Washington, D.C.
Contact: Martha Woods
USPDI,Inc.
Phone: 301-445-4405
+ June 15-17, 1994: 24th Annual International Symposium on
Fault-Tolerant Computing
Austin,Texas
Contact: Billene Mercer
Phone: 512-327-4012; FAX: 512-327-8132
+ July 26-28, 1994: Software Quality Management
Edinburgh, SCOTLAND
Contact: Sue Owen
Conference Secretariat,
Wessex Institute of Technology
Phone: 44 (0) 703 293223
========================================================================
--------->>> TTN SUBMITTAL POLICY <<<---------
--------->>> CALENDAR OF EVENTS AND CALL FOR PAPERS <<<---------
========================================================================
The TTN On-Line edition is forwarded on the 15th of each month to sub-
scribers via InterNet. To have your event listed in an upcoming issue,
please E-mail a description of your event or Call for Papers or Partici-
pation to "ttn@soft.com".
The TTN On-Line submittal policy is as follows:
o Submission deadlines indicated in "Calls for Papers" should pro-
vide at least a 1-month lead time from the TTN On-Line issue date.
For example, submission deadlines for "Calls for Papers" in the
January issue of TTN On-Line would be for February and beyond.
o Length of submitted items should not exceed 68 lines (one page).
o Publication of submitted items is determined by Software Research,
Inc., and may be edited as necessary.
========================================================================
-------------->>> TTN SUBSCRIPTION INFORMATION <<<--------------
========================================================================
To request a FREE subscription or submit articles, please E-mail
"ttn@soft.com". For subscriptions, please use the keywords "Request-
TTN" or "subscribe" in the Subject line of your E-mail header. To have
your name added to the subscription list for the quarterly hard-copy
version of the TTN -- which contains additional information beyond the
monthly electronic version -- include your name, company, and postal
address.
To cancel your subscription, include the phrase "unsubscribe" or
"UNrequest-TTN" in the Subject line.
Note: To order back copies of the TTN On-Line (August 1993 onward),
please specify the month and year when E-mailing requests to
"ttn@soft.com".
TESTING TECHNIQUES NEWSLETTER
Software Research, Inc.
901 Minnesota Street
San Francisco, CA 94107 USA
Phone: (415) 550-3020
Toll Free: (800) 942-SOFT
FAX: (415) 550-3030
E-mail: ttn@soft.com
## End ##