Reliability and Performance Tests - version 5.x

General
Automize is now 100% java and uses Suns Java 1.3 machine.  If it runs on one system, it should supposedly run on all systems.  The java machine is tested rigorously on all released platforms by Sun Microsystems Java team.   However, we rigorously test all versions of Automize on the following platforms: 
1) Windows (both 95 and NT families, including servers)
2) MacOSX, 
3) Linux Redhat 7.0 
4) Solaris Sparc 8.0
We also provide some releases for other Java 1.3 enabled platforms.  We cannot test on all other Java 1.3 platforms, however, since we confirm that it runs perfectly on windows, mac, linux and solaris, we are very confident that it will run on all other java 1.3 platforms.

Debug Log
This is one of the extremely rare software programs that exposes bugs to the users via the Debug Log.  The debug log is the single most important information we use to figure out why your tasks fails (either user input error, system or other error or bug).  We constantly refine our code when we go through your debug logs.  100% of our code is in error catching loops that write to the debug log.  This has helped the program to be extremely stable.  By version 5.x, we have cleaned up a lot bugs, from information that filtered into the users 5.x debug log.

Scheduler engine CPU usage
The scheduler engine just sets timers for your tasks.  Every task has one timer associated with it.  Typically when no tasks are running, the scheduler engine will consume almost very little (~0%) of CPU time.  When the task is triggered, the CPU usage will depend on the task.

Scheduler reliability testing
Conditions: Ultra1, Solaris 8.0, 256MB Ram, 166MHz, 2 Tasks (copy & delete) run every 15 seconds for 1 month.  
Results: RAM usage plateaus at 60-80 MB during the entire month.  CPU usage ~2-5%

Zip Task
Conditions:
Win2000, 256MB Ram, 667 MHz, Source folder size = ~1.8 GB, Source files zipped = 20031
Results: Zip time = ~24 minutes, Zip file size = ~1.3GB, Average CPU =~70-90%
Output:
May 17, 2002 1:23:49 PM
Zip Directories - Zip
Zip session summary:
Number of files in directory = 20031
Number of files passing filename filter = 20031
Number of files passing date modified criteria = 20031
Number of files zipped = 20031
Zip file created : C:\Documents and Settings\melvin\junk\Zip.zip
File Size = 1325729962 bytes

May 17, 2002 1:23:50 PM
Zip Directories - Zip - Exit Code = 0

Copy Task
Conditions:
Win2000, 256MB Ram, 667 MHz, Source folder size = ~150 MB, Source files copied = 5667, Subfolders = 419
Results: Copy time = ~5 minutes, Average CPU =~20-40%.  
Output:
May 17, 2002 2:00:10 PM
Copy Files - Copy
Copy session summary:
Number of files in directory = 5667
Number of files passing filename filter = 5667
Number of files passing date modified criteria = 5667
Number of older source files copied (only if 'Ignore file timestamp' option is selected) = 0
Number of source files older than target files (i.e. not copied) = 0
Number of files copied = 5667

May 17, 2002 2:00:11 PM
Copy Files - Copy - Exit Code = 0

Ftp Task
Conditions:
Client Win2000, 256MB Ram, 667 MHz.  Ftp Server = Solaris Sparc 8.0, 10 Mbps network speed.
Ftp task: Source folder size = 150 MB, Source files transferred = 5642, Subfolders = 419, log transfer or backup options were NOT selected.
Results: 
Ftp Get time = ~40 minutes, client CPU usage = varies 5-20%. 
Ftp Put time = ~60 minutes, client CPU usage = varies 20-100%.
The Ftp transfer time and %CPU usage will be higher if the log transfer or backup options are selected.
Output:
May 17, 2002 5:58:36 PM
FTP session summary:
Total files = 5642
Files meeting filename criteria (C1) = 5642
Files meeting transfer criteria per date modified & criteria C1 (C2) = 5642
Files meeting transfer criteria based on new modified files & criteria C2 = 5642
Total files downloaded = 5642

May 17, 2002 5:58:37 PM
Ftp - Ftpget - Exit Code = 0