Copyright: Copyright 1993-1994 Landmark Research Int'l Corp.


landmark_help_index
Landmark 3.0 Help Index

Introduction

Overview

Configuring Landmark 3.0

Benchmarks

Main Screen

CPUmarks

FPUmarks

VIDEOmarks

Benchmark Methodology

Benchmarks and Windows

Saving Benchmark Data


Overview

Landmark 3.0 Speed Test for Windows provides accurate and complete system performance results for systems running in a Windows environment.  This program was developed for manufacturers, as well as end-users, so that they may have a means to verify and compare a system's performance.

The Landmark Speed Test is a world-famous benchmark and has been used for many years.  This version, developed specifically for the Windows operating system, includes synthetic software profiles that emulate a typical software application's actual functions in real time.  Thus, by using the software emulation provided, the user is able to compare the performance of different systems, or alternate configurations of the same system, and identify which system and/or configuration should be used for optimal system speed.

Landmark 3.0 can be run from the floppy drive and is extremely portable.  It is easy to get benchmarks from several systems quickly because installation is not required.  A database is provided to store the acquired results for easy comparison.


configuring_landmark
Configuring Landmark 3.0

Configuration Dialog Box

The configuration dialog box, available on each screen, allows for the configuration of the display orientation, and for the choice of the tests to include in the specific benchmark graph the user is currently showing.

Software Emulations

A software emulation or profile is a synthetic emulation of an actual software program's functions.  This allows the user to simulate the interaction between the system and the software without actually installing the software onto the system.  On the configuration dialog box, the user can select which profiles to use.  The default setting is all profiles selected.

Display Orientation

The user may select different options for viewing the display.  The default setting is 3D Horizontal.

When the display orientation is changed for one of the graphs in Landmark 3.0, the display changes for all of the remaining graphs in the application.

Program Switch

/V - Video driver switch

Certain video cards and drivers are known to be problematic under Windows.  If you experience a system crash while running Landmark 3.0 with these drivers, try using the /v switch and/or a standard Windows video driver.  Turning this switch on disables the full display of the animation sequence but does not affect the video benchmark.  To set this switch, select FILE / RUN from the Program Manager and enter the following command:

A:speed /v

If the program is installed on a hard drive, select the Landmark 3.0 icon.  Then, select FILE / PROPERTIES... from the Program Manager.  Select the field COMMAND LINE: and add the /v switch, as shown in the following example:

C:\speed\speed.exe /v


landmarks
Main Screen

The main screen presents a graphical representation of a computer's speed and performance and gives access to other Landmark 3.0 menus and features.

Calculated performance data for CPU, FPU, and video are displayed to enable the user to evaluate the performance of the computer system under test for comparison to other systems, or alternate configurations of the same system.  To facilitate ease of comparison, a fourth value, "Landmarks", presents an evaluation of total system performance.  The Landmarks value is a weighted average of CPUmarks, FPUmarks and VIDEOmarks.  The calculation for this weighted average is:

((CPUmarks * 4) + FPUmarks + (VIDEOmarks * 2)) / 7 = Landmarks

Essentially, this means that the CPUmarks contribute approximately 57%, FPUmarks 14%, and VIDEOmarks 29% to the Landmarks value.

Landmark 3.0 allows the user to easily determine the optimum computer system for their needs.


CPUmarks

On the main screen and the CPU screen, the system's CPU is identified and the CPUmarks value is presented.  Also presented on the CPU screen are values for the individual CPU tests.  CPUmarks is the average of the four CPU software emulations.  The "synthetic" benchmarks, Sieve and Dhrystones, are not included in this calculation.

Software Emulations

The software emulations for CPU testing are Paradox, Microsoft Excel, WordPerfect, and Harvard Graphics.  These software application profiles were done in the following manner:

Paradox - Paradox was chosen as an application benchmark because it is one of the most widely used database products on the market today.  It is a relational database with its own application language.

The types of applications whose performance might be comparable to Paradox would be programs functioning as database managers, mailing list systems, and accounting software, such as dBASE, FoxPro, and Access.  If you wish to run a database program, this performance benchmark might show you (without the variances from disk performance) which system is configured for optimal performance for databases.  The Paradox profile is actually a CPU instruction mix for Borland Paradox.  A sample database was used and common database actions/functions and their effects on the CPU were recorded.

Microsoft Excel - Microsoft Excel is one of the most widely used spreadsheets on the market today.  It was included in our application benchmarks for this reason.

The types of applications whose performance might be comparable to Microsoft Excel would be programs functioning as spreadsheets, such as Lotus 1-2-3 or Quattro Pro.  If you wish to run a spreadsheet program, this performance benchmark might show you (without the variances from disk performance) which system is configured for optimal performance for spreadsheets.  The Excel profile is actually a CPU instruction mix for Microsoft Excel.  A sample spreadsheet was used and common spreadsheet actions/functions and their effects on the CPU were recorded.

WordPerfect - WordPerfect is one of the most popular word processing applications found today.  It was included in our application benchmarks for this reason.

The types of applications whose performance might be comparable to WordPerfect would be programs functioning as word processors, such as Microsoft Word or Ami Pro.  If you wish to run a word processing program, this performance benchmark might show you (without the variances from disk performance) which system is configured for optimal performance for word processors.  The WordPerfect profile is actually a CPU instruction mix for WordPerfect.  A sample word processor was used and common word processing actions/functions and their effects on the CPU were recorded.

Harvard Graphics - Harvard Graphics was chosen as an application benchmark because it is one of the most widely used graphics and presentation software packages available today.

The types of applications whose performance might be comparable to Harvard Graphics would be programs functioning as desktop publishing and/or presentation programs, such as Aldus PageMaker or Microsoft Power Point.  If you wish to run this type of program, this performance benchmark might show you (without the variances from disk performance) which system is configured for optimal performance for graphics, desktop publishing and presentations.  The Harvard Graphics profile is a CPU instruction mix for Harvard Graphics.  This package was used and common graphics and presentation software actions/functions and their effects on the CPU were recorded.

Synthetic Benchmarks

The synthetic benchmarks for CPU testing are Sieve of Eratosthenes and Dhrystones.

Sieve of Eratosthenes - The Sieve of Eratosthenes is a measure of system performance based on the ancient Greek astronomer Eratosthenes' method of generating prime numbers.  This method of benchmarking is often used by programmers due to its simplicity, and ease of coding.  The speed results of Sieve are a representation of the total system performance and the compiler optimizations used.

Dhrystone - A measure of integer (non-floating point) performance of the system.  Dhrystone is a "synthetic" benchmark and simulates "normal" system operation.  The dhrystone benchmark typically executes assignment instructions, control statements, and procedure function calls in a loop.

CPU MHz

The CPU Clock Speed, represented in MegaHertz, is presented on the main screen and on the CPU screen.  The amount of time necessary for the CPU to execute 1,000 AAD (Ascii Adjust before Divide) instructions determines this value.

Note:

Keep in mind that actual application performance may be greatly affected by disk performance and other system configuration factors such as caching, memory, and network connections.  Therefore, the performance you get on your particular system may vary greatly from another system.


FPUmarks

On the main screen and the FPU screen, the system's FPU is identified and the FPUmarks value is presented.  Also presented on the FPU screen are values for the individual FPU tests.  FPUmarks is the average of the two FPU software emulations.  The "synthetic" benchmarks, Whetstone, Logstone, and Anglestone, are not included in this calculation.

Software Emulations

The software emulations for FPU testing are Microsoft Excel, and AutoCAD.  These software application profiles were done in the following manner:

AutoCAD - AutoCAD is a popular Computer Aided Design package, and utilizes the FPU extensively.  It was included in our application benchmarks for this reason.

The types of applications whose performance might be comparable to AutoCAD might be programs functioning as math intensive programs, such as TurboCAD or Mathematica.If you wish to run a CAD or math intensive program, this performance benchmark might show you (without the variances from disk performance) which system is configured for optimal performance for these types of programs.  The AutoCAD profile is a FPU instruction mix for AutoCAD.  A sample CAD program was used and common CAD actions/functions and their effect on the FPU were recorded.

Microsoft Excel - Microsoft Excel is one of the most widely used spreadsheets on the market today.  It was included in our application benchmarks for this reason.

The types of applications whose performance might be comparable to Microsoft Excel would be programs functioning as spreadsheets, such as Lotus 1-2-3 or Quattro Pro.  If you wish to run a spreadsheet program, this performance benchmark might show you (without the variances from disk performance) which system is configured for optimal performance for spreadsheets.  The Excel profile is a FPU instruction mix for Microsoft Excel.  A sample spreadsheet was used and common spreadsheet actions/functions and their effect on the FPU were recorded.

Synthetic Benchmarks

Whetstone - A measure of floating point performance of the system.  Whetstone is a "synthetic" benchmark that is representative of the scientific processing capabilities of the system.

Logstone - Logstone is a new Landmark benchmark.  In order to benchmark the performance of the FPU, log base 10 calculations are performed, and the time necessary to complete them is recorded.

Anglestone - Anglestone is a new Landmark benchmark.  In order to benchmark the performance of the FPU, cosine and sine instructions are executed.

FPU MHz

The FPU Clock Speed, represented in MegaHertz, is presented on the FPU screen.  This value matches the CPU Clock Speed.

Note:

Keep in mind that actual application performance may be greatly affected by disk performance and other system configuration factors such as caching, memory, and network connections.  Therefore, the performance you get on your particular system may vary greatly from another system.


VIDEOmarks

On the main screen and the video screen, the VIDEOmarks value is presented.  Also presented on the video screen are values for the individual video tests.  The computer's ability to draw lines, draw and fill boxes, move a single graphic picture, draw and fill ellipses, draw various graphics, draw and fill concentric circles, open and close windows, and finally, display animation and text is tested.  VIDEOmarks is the average of all video test values.

Note:

Keep in mind that actual application performance may be greatly affected by disk performance and other system configuration factors such as caching, memory, and network connections.  Therefore, the performance you get on your particular system may vary greatly from another system.


benchmark_methodology
Benchmark Methodology

A system "benchmark" is essentially a measure of performance.  Landmark 3.0 provides a simulation of actual system operation.  The following process was used to accomplish this measurement.

Identification of the software applications Landmark wanted to use was made.  Selected for their popularity and functionality, these applications were run and the results were captured.  These results included an instruction mix of the CPU and FPU instructions executed, the CPU and data cache hit rate, and the address locality and branching signatures.

An instruction mix is developed by looking at the actual programs and then studying the ratio of instructions performed at the lowest level of hardware.  By studying the ratio, it is possible to get a good idea of how the program works.  The analysis of this performance allows the appropriate ratio of instructions (such as memory fetches, memory stores, additions, subtractions, multiplications, divisions, etc.) to be determined and converted into a synthetic benchmark by Landmark.  Using this synthetic benchmark, the same data captured previously was captured again.

The process of capturing data with the synthetic benchmark was continued and fine-tuned until the data matched that captured using the real application.

To ensure the accuracy of the CPU and FPU benchmarks, the following guidelines were established and adhered to during testing:

In order to ensure accurate timing of the benchmarks, an internal timer was dedicated to the process.  This gives a timing resolution of 0.0838 microseconds.  This timer was used for all operations.

Interrupts were disabled during all CPU and FPU measurements.


benchmarks_and_windows
Benchmarks and Windows

The user should keep in mind that actual application performance may be greatly affected by  system configuration factors, such as the Windows program, caching, memory, and network connections.  Therefore, the performance you get on different systems may vary greatly depending upon the system's setup.

Thus, dual scenarios emerge.  If you want to check the influence of different Windows programs, drivers, or configurations on your system, Landmark 3.0 provides you with this information.  However, to accurately compare different systems, ideally they should all be configured exactly alike in order to obtain apples vs. apples results.


saving_benchmark_data
Saving Benchmark Data

The Performance Database available to the user stores information and measurements taken from various systems after the execution of Landmark 3.0.  This data is identical to that data found on the CPU, FPU, and VIDEO graphs.  In addition, information about the system such as the speed of the coprocessor and the manufacturer is included.  Speeds recorded are in Operations per Second.

Add

By selecting the "Add" button, the user can input information concerning the system under test.  When the information has been entered, press the "Add" button to save the information.  All of the information is saved in the database for future review and comparison.

Remove

After highlighting a record in the database, it can be removed from the database by clicking on the "Remove" button.

Edit

After highlighting a record in the database, it can be edited by selecting the "Edit" button.

Sort

Records can be sorted 5 ways:  Alphabetic, CPUmarks, FPUmarks, VIDEOmarks, Landmarks

Alphabetic - Sorts in alphabetic ascending order on the system name field.

CPUmarks - Sorts records based on the CPUmark field value.  The highest value is the first record, descending to the lowest CPUmark value.

FPUmarks - Sorts records based on the FPUmark field value.  The highest value is the first record, descending to the lowest FPUmark value.

VIDEOmarks - Sorts records based on the VIDEOmark field value.  The highest value is the first record, descending to the lowest VIDEOmark value.

Landmarks - Sorts records based on the Landmarks field value.  The highest value is the first record, descending to the lowest Landmark value.

Viewing Vendor Information

Click the mouse on the "Vendor" button if you wish to review vendor information you have previously entered with the "Add" or "Edit" button.

Printing the Performance Database

To print out the information held in the database, click on the "Print" button.  Use the Windows Print Manager / Printer Setup to determine the printer, port, and orientation (landscape or portrait) for printing the results from Landmark 3.0.