IMPORTANT NOTICE:

CaffeineMark 3.0 scores cannot be compared on an equal footing with scores from earlier versions of the CaffeineMark.

CaffeineMark 3.0 consists of new tests and the overall CaffeineMark score is computed using a different scoring/averaging scheme.

Pendragon Software Home Page

CaffeineMark Home Page

Run the CaffeineMark

Benchmark Information

CaffeineMark Results

License and Results Publishing Guidelines

CaffeineMark 3.0 Information

Overview
Why we updated the benchmark
What the tests do
How to run the tests
The Embedded CaffeineMark

Early Results

Download the CaffeineMark Kit

Overview

The CaffeineMark is a series of tests that measure the speed of Java programs running in various hardware and software configurations. CaffeineMark scores roughly correlate with the number of Java instructions executed per second, and do not depend significantly on the the amount of memory in the system or on the speed of a computers disk drives or internet connection.

CaffeineMark scores have been climbing steadily over the last year, as Java system vendors have improved the capability their virtual machine technology. These improvements transform Java bytecode into highly optimized native code.

Recently, the technology has become so advanced that CaffeineMark version 2.5 reported results that do not reflect real world Java performance (see Why we updated the benchmark). The super high scores were generated because the compilers realized that the benchmark did not actually use the results of calculations performed during the test.CaffeineMark was too is because

Software has lead this revolution by improving performance by a factor of 20 on some systems.

What the tests do

The CaffeineMark uses 9 tests to measure various aspects of Java virtual machine (VM) performance. Each test runs for approximately the same length of time. The score for each test is proportional to the number of times the test was executed divided by the time taken to execute the test.

The following is a brief description of what each test does:

Sieve
The classic sieve of eratosthenes finds prime numbers.

Loop
The loop test uses sorting and sequence generation as to measure compiler optimization of loops.

Logic
Tests the speed with which the virtual machine executes decision-making instructions.

Method
The Method test executes recursive function calls to see how well the VM handles method calls.

Float
Simulates a 3D rotation of objects around a point.

Graphics
Draws random rectangles and lines.

Image
Draws a sequence of three graphics repeatedly.

Dialog
Writes a set of values into labels and editboxes on a form.

The overall CaffeineMark score is the geometric mean of the individual scores, i.e., it is the 9th root of the product of all the scores.

How to run the tests

To run the tests, go to the testing page, and wait for the CaffeineMark window to appear. Then select Run All Tests from the Test menu. The test will take approximately 45 seconds.

The Embedded CaffeineMark

The Embedded CaffeineMark combines the scores of the non-graphical tests (i.e., it excludes the Graphics, Image and Dialog) into an overall score. The Embedded CaffeineMark is available as a downloadable zip file for testing embedded applications and Java-powered consumer electronics systems.

For convenience, the standard version of the benchmark includes a menu option that will compute the Embedded CaffeineMark for a system.

IMPORTANT NOTICE:

CaffeineMark 3.0 scores cannot be compared on an equal footing with scores from earlier versions of the CaffeineMark.

CaffeineMark 3.0 consists of new tests and the overall CaffeineMark score is computed using a different scoring/averaging scheme.

© Copyright 1997 Pendragon Software Corporation. All rights reserved. CaffeineMark is a trademark of Pendragon Software. Java and HotJava are trademarks of Sun Microsystems, Inc., and refer to Sun's Java programming language and HotJava browser technologies.