
Subject: SPSS Reports Errors In Tests.


Path: math.fu-berlin.de!zib-berlin.de!prise.nz.dlr.de!news.dfn.de!swiss.ans.net!howland.reston.ans.net!news.sprintlink.net!news.cloud9.net!beveridg
From: beveridg@cloud9.net (Andrew Beveridge)
Newsgroups: comp.sys.intel
Date: 3 Dec 1994 01:05:07 GMT
Organization: Cloud 9 Internet + White Plains, New York USA
Lines: 120
Message-ID: <3bog8m$drp@news.cloud9.net>
Summary: SPSS Reports Test Suite Has Errors On Pentium
Keywords: Pentium, Statistics

SPSS, Inc. posted the following statement on their list.  This along with 
STATa's analysis means that the Pentium bug has a real chance of 
occaisionally causing "real" that is non-trivial error.

From news.cloud9.net!news.sprintlink.net!howland.reston.ans.net!math.ohio-state.edu!uwm.edu!lll-winken.llnl.gov!decwrl!pagesat.net!internet.spss.com!nichols Fri Dec  2 19:45:38 1994
Newsgroups: comp.soft-sys.spss
Path: news.cloud9.net!news.sprintlink.net!howland.reston.ans.net!math.ohio-state.edu!uwm.edu!lll-winken.llnl.gov!decwrl!pagesat.net!internet.spss.com!nichols
From: nichols@spss.com (David Nichols)
Subject: Pentium Bug and SPSS Software
Message-ID: <D074J6.9tr@spss.com>
Sender: news@spss.com
Organization: SPSS, Inc.
Date: Fri, 2 Dec 1994 18:25:52 GMT
Lines: 102

No, you're not imagining things: this is another posting of this statement.
The previous one had a word left out in the discussion of how to turn off
the machine's FPU when running DOS products. This is a corrected version.

                      The Pentium Bug and SPSS Software

                                 Jon K. Peck
                        Vice President for Technology
                                  SPSS Inc.
                                   12/1/94

Intel Corp has acknowledged that there is a bug in the existing Pentium CPUs
that produces an incorrect result equivalent to reduced precision in 1 case
in 9 billion floating point division operations. The President of Intel,
Andy Grove, stated

     This group [Intel engineers] concluded after months of work that (1) an
     error is only likely to occur at a frequency of the order of once in nine 
     billion random floating point divides, and that (2) this many divides in
     all the programs they evaluated (which included many scientific programs)
     would require elapsed times of use that would be longer than the mean
     time to failure of the physical computer subsystems.

While this low frequency of occurrence, if correct, would be reassuring, we
believe that information on the experience users of SPSS for Windows, SYSTAT,
and other SPSS products might encounter would be useful. Uncertainty exists
concerning how many such division operations would be carried out in various
statistical analyses, whether these can be regarded as "random floating point
divides", and what the consequences of the error would be in statistical
output if it does occur.

It is clearly possible to exhibit the Pentium error in an SPSS for Windows
transformation. The statement

compute result = (4195835 / 3145727) * (3145727).

should produce the result 4195835.  On the Pentium, however, the result is off
by 256. A similar result can be demonstrated for SYSTAT.

In order to explore the consequences of the division error in statistical 
procedures, we have run a portion of our standard statistical test bed for
SPSS for Windows on a Pentium system, which consumed a few hours of Pentium
time. The portion run executes a total of 746 statistical procedures using
various data sets. These jobs cannot be considered as typical of user jobs 
because they over represent unusual or extreme data conditions and 
pathological models, although considerable real data is included. We compared
the results with our baseline output, which was created on a 486 system,
considering only differences occurring before the fifth decimal place as 
printed. Since extremely large or small values are printed in scientific 
notation, these differences may vary in magnitude.

In the 746 tests,  we found two instances where the Pentium bug appears to 
have produced a difference in the output bigger than the fifth decimal place.
The first difference appeared in an extreme generalized log odds ratio 
calculation from the GENLOG procedure, and the second occurred in an extremely 
large chi-squared statistic.  In the first case, the difference was in the 
second significant figure in an extremely small value (10**-18).  In the 
second case, the difference was in the fifth significant figure of an 
extremely large value (10**265).

We searched for differences of any magnitude in selected numerically complex 
procedures and found one additional difference in the CNLR procedure with
bootstrapping.  This difference was very small but is not associated with an
extreme dataset or model.  The difference was in the seventh decimal place of
a coefficient confidence interval.

There is no work around strategy available for SPSS Windows products, 
including SPSS for Windows and SYSTAT for Windows, and in principle the bug, 
though rare, could affect nearly any statistical calculation. For SPSS and 
SYSTAT DOS products, hardware floating point calculation can be converted to 
software emulation, which will eliminate the erroneous behavior but will slow 
down the software substantially. To change to software emulation, issue the 
following DOS command before starting the product.

SET NO87=no floating point

The O is the letter "O"; not zero. The actual text to the right of the equals 
sign does not matter.

Intel has requested that Pentium owners who are concerned should contact their 
customer support at 800-628-8686 (US number).

In conclusion, the Pentium bug can have visible consequences with no warning 
signals in real statistical procedures that are written with careful attention
to numerical issues.  It can occur for realistic data sets and problems. While
the differences we have observed would not have affected any inferences, we
cannot rule out more serious consequences.  When the user community has made
comparisons using their data sets and models, we will know better the impact 
of this bug.

We invite users of SPSS products to send data sets and jobs in which they 
detect a meaningful difference in output between a Pentium and a 486 processor
to SPSS Technical Support. Users can upload data and syntax files to our forum
on CompuServe or use anonymous ftp to upload it to spss.com. Examples that do
not require a data file may be e-mailed to support@spss.com or faxed to SPSS
Technical Support in the United States at 312-329-3668.

--
-----------------------------------------------------------------------------
David Nichols             Senior Support Statistician              SPSS, Inc.
Phone: (312) 329-3684     Internet:  nichols@spss.com     Fax: (312) 329-3668
-----------------------------------------------------------------------------

