Reliability and Performance Tests - version 5.x
General
Automize is now 100% java and uses Suns Java 1.3 machine. If it
runs on one system, it should supposedly run
on all systems. The java machine is tested rigorously on all released
platforms by Sun Microsystems Java team. However, we rigorously test
all versions of Automize on the following platforms:
1) Windows (both 95 and NT families, including servers)
2) MacOSX,
3) Linux Redhat 7.0
4) Solaris Sparc 8.0
We also provide some releases for other Java 1.3 enabled platforms. We
cannot test on all other Java 1.3 platforms, however, since we confirm that it
runs perfectly on windows, mac, linux and solaris, we are very confident that it
will run on all other java 1.3 platforms.
Debug Log
This is one of the extremely rare software programs that exposes
bugs to the users via the Debug Log. The debug log is the single most
important information we use to figure out why your tasks fails (either user
input error, system or other error or bug). We constantly refine
our code when we go through your debug logs. 100% of our code is in
error catching loops that write to the debug log. This has helped the program
to be extremely stable. By version 5.x, we have cleaned up a lot bugs,
from information that filtered into the users 5.x debug log.
Scheduler
engine CPU usage
The scheduler engine just sets timers for your tasks. Every
task has one timer associated with it. Typically when no tasks are
running, the scheduler engine will consume almost very little (~0%) of CPU
time. When the task is triggered, the CPU usage will depend on the task.
Scheduler reliability testing
Conditions: Ultra1, Solaris 8.0, 256MB Ram, 166MHz, 2 Tasks
(copy & delete) run every 15 seconds for 1 month.
Results: RAM usage plateaus at 60-80 MB during the entire month.
CPU usage ~2-5%
Zip Task
Conditions: Win2000, 256MB Ram, 667 MHz, Source folder size = ~1.8 GB, Source files zipped = 20031
Results: Zip time = ~24 minutes, Zip file size = ~1.3GB, Average CPU =~70-90%
Output:
May 17, 2002 1:23:49 PM
Zip Directories - Zip
Zip session summary:
Number of files in directory = 20031
Number of files passing filename filter = 20031
Number of files passing date modified criteria = 20031
Number of files zipped = 20031
Zip file created : C:\Documents and Settings\melvin\junk\Zip.zip
File Size = 1325729962 bytes
May 17, 2002 1:23:50 PM
Zip Directories - Zip - Exit Code = 0
Copy Task
Conditions: Win2000, 256MB Ram, 667 MHz,
Source folder size = ~150 MB, Source files copied = 5667, Subfolders = 419
Results: Copy time = ~5 minutes, Average CPU =~20-40%.
Output:
May 17, 2002 2:00:10 PM
Copy Files - Copy
Copy session summary:
Number of files in directory = 5667
Number of files passing filename filter = 5667
Number of files passing date modified criteria = 5667
Number of older source files copied (only if 'Ignore file timestamp' option is selected) = 0
Number of source files older than target files (i.e. not copied) = 0
Number of files copied = 5667
May 17, 2002 2:00:11 PM
Copy Files - Copy - Exit Code = 0
Ftp
Task
Conditions: Client Win2000, 256MB Ram, 667 MHz. Ftp Server =
Solaris Sparc 8.0, 10 Mbps network speed.
Ftp task: Source folder size = 150 MB, Source files transferred = 5642,
Subfolders = 419, log transfer or backup options were NOT selected.
Results:
Ftp Get time = ~40 minutes, client CPU usage = varies 5-20%.
Ftp Put time = ~60 minutes, client CPU usage = varies 20-100%.
The
Ftp transfer time and %CPU usage will be higher if the log transfer or backup
options are selected.
Output:
May 17, 2002 5:58:36 PM
FTP session summary:
Total files = 5642
Files meeting filename criteria (C1) = 5642
Files meeting transfer criteria per date modified & criteria C1 (C2) = 5642
Files meeting transfer criteria based on new modified files & criteria C2 = 5642
Total files downloaded = 5642
May 17, 2002 5:58:37 PM
Ftp - Ftpget - Exit Code = 0