R. Scott Truesdell (tcl/tk) and Marlon Vieira (Java)
July, 1999
based on Sobeit 1.x by Chang Liu

Document History | Download & Install | Environment Setup | Running SoBeIt | Changes in vers. 2.0

SYNOPSIS

SOBEIT is a software verification tool for specification-based testing.

Version 2 of SOBEIT has, as the primary requirement, the ability to use a shared FSA engine developed at University of Massachusetts, Amherst. In addition to this primary requirement, several other enhancements have been incorporated into this version.

• Overall program robustness has been improved throughout by trapping for missing files and other problems that could cause program termination.
• References to hard-coded paths have been systematically removed. All paths are being referenced to the environment variable SOBEIT_HOME.
• A "prefs" facility has been included to add persistence to various program settings across invocations of SOBEIT.
• Supports either GIL-based or FSA-based oracles via menu selection (view screen-shot.)
• The global variable oracle_generator is set to an initial value stored in "prefs". At this time, oracle_generator may be one of the following three values: "FSA", "GIL", or "none", and it is case sensative.
• A new global named test_suite_home has been added so that searching for files when setting up a test can begin from a common root. test_suite_home is persistant via the "prefs" facility. In addition, since SOBEIT tests tend to spew out dozens of files during testing, the results files are also written in test_suite_home.
• Support has been added for directly invoking an oracle editor (view screen-shot.) Currently the only editor supported is the FSAEditor from UMass, though support for other editors can be easily added in the future.
• Testers are aided in the correct sequence of a test by disabling and/or activating user interface elements as appropriate.
• Support has been added for interactive handling of invalid test events. When the FSA engine returns an "invalid" the tester may choose to ignore this event, ignore all future invalid events, or halt the test case or the entire suite. The default is to "ignore this event", which will be activated after a 30-second time-out.
• SOBEIT runs directly from the command line -- simply type "Sobeit" and program execution begins. Alternatively, Sobeit may be run from any directory via the command $SOBEIT_HOME/Sobeit, and the user will be returned to their original directory after the run is completed.

Future Enhancements

• Implementation of a GUI to the "prefs" facility.
• Add support for setting the default action for invalid events and setting the time-out interval, both stored in "prefs".
• Currently, test_suite_home is set to the directory of the last selected file (Suite, Executable, or Oracle) and this is where results files will go. I will make a new field for specifying where results should go, defaulting to test_suite_home.
• Support will be added for multiple FSA-based oracles in any given test run. Multiple oracles will be selected via a point-and-click addition to the main execution window (view screen-shot.)
• Improving the overall robustness of Sobeit and the user interface will be an ongoing project.

Document History | Download & Install | Environment Setup | Running SoBeIt | Changes in vers. 2.0

DOCUMENT HISTORY

1. This will be UCI version of SOBEIT
2. Copied from ~cliu1/mcc.open Jan. 3, 1998
3. Copied from ~softtest/sobeit July 1, 1999 RSTruesdell
4. This document current as of August 11, 1999.

DOWNLOADING & INSTALLING SOBEIT

SoBeIt v2 is distributed as a compressed tar file. When uncompressed, sobeit_2.tar.gz will make a directory called "sobeit" in your current working directory.

sobeit_2.tar.gz will be able to be downloaded from ftp.ics.uci.edu/pub/rosatea.

Change to the directory that you want the "sobeit/" directory to reside in and move "sobeit_2.tar.gz" to this directory.

% gunzip sobeit_2.tar.gz
% tar xvf sobeit_2.tar
%

ENVIRONMENT SETUP

Required Software:

• Tcl/Tk 8.0 or later
• tix 4.0 or later
• Java 1.2.0 or later
• Solaris 2.5 or later (SunOS 5.5.1)

Environment Variables:

The environment variable CLASSPATH must be set as appropriate to look for the FSA java classes. Example:

setenv CLASSPATH "home/truesdel/sharedFSA:/home/truesdel/jws:."

The environment variable SOBEIT_HOME must be setup as appropriate to find files relative to the executable. There are several ways to set this important environment variable; here are a few:

1. Add it in your shell's initialization file (e.g. ~/.cshrc) Example:
   setenv SOBEIT_HOME "/home/truesdel/rosatea/sobeit"
# This first method is the preferred method.
2. Change to the directory in which Sobeit resides and enter the command(s):
   # if your shell is csh, tcsh, bash:
setenv SOBEIT_HOME $cwd
# if your shell is sh or korn:
SOBEIT_HOME=`pwd`
export SOBEIT_HOME
3. Type in the entire path before program execution. You may be in any directory if you use the full pathname. Example:
   setenv SOBEIT_HOME "/home/truesdel/rosatea/sobeit"

Document History | Download & Install | Environment Setup | Running SoBeIt | Changes in vers. 2.0

Running SOBEIT

% module load tcl tk tix
% module load java-jdk/1.2.01
% # change to whichever directory in which the file "Sobeit" resides:
% cd $SOBEIT_HOME
% Sobeit
% # or you can invoke from any directory by specifying the full path:
% $SOBEIT_HOME/Sobeit

Document History | Download & Install | Environment Setup | Running SoBeIt | Changes in vers. 2.0

CHANGES INCORPORATED INTO VERSION 2.0, JULY, 1999

1. ExecMonitor - work started. Abandoned; will be rolled into InstrumentWF.
2. InstrumentW.tcl - removed references to /home/cliu1, replaced with environment variable "SOBEIT_HOME".
3. InstrumentWF.tcl - new user interface for InstrumentW.tcl rolls in elements of ExecMonitor. Incomplete.

   ---

4. OrListBuilder.tcl - interface to build up a list of oracles for multi-FSA testing. Abandoned; rolled into newExecWindow.tcl.
5. newExecWindow - removes single oracle selection and replaces it with a list of oracles and a way to build and edit the list using buttons to browse directories. Eventually to replace "ExecSuiteD.tcl".
6. ExecSuiteDF.tcl - replaces "ExecSuiteD.tcl". Modified extensively to allow either GIL-based or FSA-based oracles, removed hard-coded paths, and allow multiple oracles per test run. Will be merged with newExecWindow in next version.

   ---

7. Sobeit - replaces "uci.tcl". Adds menu-selection of oracle generator type (GIL or FSA), adds "Edit Oracle" button. Disables and Activates buttons as appropriate.
8. SuiteResultWF.tcl -
9. globalsF.tcl - a few new globals added, old ones commented out.
10. prefs.tcl - Work started. Will be a GUI for setting some global behavior of the SoBeIt program. Will perform automatic tests for prefs file, SOBEIT_HOME, etc..
11. fsaWrapper.class - glue routines in Java between Sobeit and the shared FSA engine from UMass.
12. bin/runWrapper - shell script to invoke the fsaWrapper.
13. bin/runFSAEditor - shell script to invoke the UMass FSA editor.

Document History | Download & Install | Environment Setup | Running SoBeIt | Changes in vers. 2.0

The ROSATEA tools are research prototypes, some of which have been successfully transitioned into use on real projects, but not yet as commercial systems. These tools were developed by the Research Organization for Specification- and Architecture-based Testing E (&) Analysis at the University of California at Irvine. The work was done in conjunction with the Perpetual Testing Projects sponsored by the DARPA's EDCS program.

Document History | Download & Install | Environment Setup | Running SoBeIt | Changes in vers. 2.0