IMPORTANT NOTICE: CaffeineMark 3.0 scores cannot be compared on an equal footing with scores from earlier versions of the CaffeineMark. CaffeineMark 3.0 consists of new tests and the overall CaffeineMark score is computed using a different scoring/averaging scheme. |
CaffeineMark 3.0 InformationOverview | |
Overview | The CaffeineMark is a series of tests that measure
the speed of Java programs running in various
hardware and software configurations.
CaffeineMark scores roughly correlate with the
number of Java instructions executed per second,
and do not depend significantly on the the amount of
memory in the system or on the speed of a
computers disk drives or internet connection. CaffeineMark scores have been climbing steadily over the last year, as Java system vendors have improved the capability their virtual machine technology. These improvements transform Java bytecode into highly optimized native code. Recently, the technology has become so advanced that CaffeineMark version 2.5 reported results that do not reflect real world Java performance (see Why we updated the benchmark). The super high scores were generated because the compilers realized that the benchmark did not actually use the results of calculations performed during the test.CaffeineMark was too is because Software has lead this revolution by improving performance by a factor of 20 on some systems. |
What the tests do | The CaffeineMark uses 9 tests to measure various
aspects of Java virtual machine (VM) performance.
Each test runs for approximately the same length of
time. The score for each test is proportional to the
number of times the test was executed divided by
the time taken to execute the test. The following is a brief description of what each test does: Sieve Loop Logic Method Float Graphics Image Dialog The overall CaffeineMark score is the geometric mean of the individual scores, i.e., it is the 9th root of the product of all the scores. |
How to run the tests | To run the tests, go to the testing page, and wait for the CaffeineMark window to appear. Then select Run All Tests from the Test menu. The test will take approximately 45 seconds. |
The Embedded CaffeineMark | The Embedded CaffeineMark combines the scores
of the non-graphical tests (i.e., it excludes the
Graphics, Image and Dialog) into an overall score.
The Embedded CaffeineMark is available as a
downloadable zip file for testing embedded
applications and Java-powered consumer
electronics systems. For convenience, the standard version of the benchmark includes a menu option that will compute the Embedded CaffeineMark for a system. |
IMPORTANT NOTICE: CaffeineMark 3.0 scores cannot be compared on an equal footing with scores from earlier versions of the CaffeineMark. CaffeineMark 3.0 consists of new tests and the overall CaffeineMark score is computed using a different scoring/averaging scheme. |
© Copyright 1997 Pendragon Software Corporation. All rights reserved. CaffeineMark is a trademark of Pendragon Software. Java and HotJava are trademarks of Sun Microsystems, Inc., and refer to Sun's Java programming language and HotJava browser technologies. |