[Top] [Prev] [Next] [Bottom]




WEBsweeper general


The default WEBsweeper configuration uses several files to hold the configuration details (MSW\CONFIG\*.CFG).

These are:

Contents File
Main configuration details. WEBSWP.CFG
HTTP configuration details. HTTP.CFG
FTP configuration details. FTP.CFG

The first file that WEBsweeper reads on startup is the web configuration file, WEBSWP.CFG. This file contains details on system configuration information, logging and the other files that WEBsweeper uses.

WEBSWP.CFG contains six main configuration sections, these are:

[ProgressMessages] section

WEBsweeper has the facility to provide progress messages to Web browsers during the transfer of large files. These messages provide information on the current state of the transfer, including, the requested URL, the amount of data received so far, and whether WEBsweeper is receiving data, validating data, or completed.

See page 3-31 for a more details on progress messages and a sample message.

The [ProgressMessages] configuration section provides the information needed to enable this facility. This section is found in the main web configuration file, WEBSWP.CFG.

The [ProgressMessages] section lists five directives, these are:

For example:

[ProgressMessages]
Enabled=TRUE
DownloadTimeThreshold=20
UpdateRate=5
Port=1081
ContentType=application
ContentType=text

Enabled

The Enabled directive specifies whether progress messages are to be enabled or disabled. It can have the value TRUE or FALSE. The default value is TRUE, meaning that progress messages are enabled.

DownloadTimeThreshold

WEBsweeper estimates the total time a resource will take to download and validate. If the estimated download time is longer than the value specified by the DownloadTimeThreshold directive then progress messages will be sent to the browser.1 If progress messages are appropriate, they will appear shortly after the download commences.

The DownloadTimeThreshold value is specified in seconds. Default is 20 seconds.

UpdateRate

The UpdateRate directive specifies how often the information displayed in the progress message should be updated. The value is specified in seconds. Default is 5 seconds.

Port

Progress messaging requires the use of a port. The port used is specified by the Port directive of the [ProgressMessages] section. By default this is 1081 but this can be changed if required.

You must ensure that port 1081 is not already in use. If it is then you will have to select a different port.

ContentType

The ContentType directive specifies the types of content for which you wish to provide progress messages. By default, progress messages are provided for the content types application and text.

It is not necessary to specify multiple variants of general content types. For example, in the default configuration, the value application is specified. This value ensures that progress messages are provided for resources of type application/octet-stream, application/zip and so on.

There can be as many ContentType directives listed as are required, that is, one for specifying each content type for which progress messages should be provided.

Assuming progress messages are enabled, they will occur for HTTP downloads under the following conditions:

Content type matches list specified Content length

is known

Download time exceeds the threshold Progress message

are supplied

Yes Yes Yes
Yes No No
No No Yes
No Don't care Don't care No

Progress messages will always occur for FTP downloads.

[URLBlocker] section

WEBsweeper can be configured to block access to known URLs for all Web browsers on your network.

One of the ways in which you can configure WEBsweeper to block URLs is by using your own, or a third party URL-blocker that has been written specifically for WEBsweeper.

Configuration details for these URL-blockers can be specified using the [URLBlocker] configuration section. This section is found in the main web configuration file, WEBSWP.CFG.

That is:

;[URLBlockers]

By default this section is commented out and contains no information.

If you wish to use this method of URL blocking then you should ensure the section is no longer commented out and then add a directive to the configuration section for each of the URL blockers.

The [URLBlockers] section can contain one or more directives, that is, one for each URL blocker used.

For example:

[URLBlockers]
Blocker1=c:\MSW\Config\blocker

The name of the directive is the configuration section for the blocker, the value is the name of the blocker .DLL.

See page 6-33 for more details on how to configure the [URLBlockers] section.

See page 6-32 for more details on the other methods WEBsweeper uses to block URLs.

[ResourceLimit] section

When WEBsweeper validates a file, it requires the whole file to be stored in memory. Furthermore, any files that have been decompressed during WEBsweeper disassembly will also be stored, along with the original. This can therefore be a memory intensive process.

There are certain situations where you may want to limit the amount of memory WEBsweeper uses:

WEBsweeper allows you to control the amount of memory allowed for file validation. This is achieved using the [ResourceLimit] configuration section, found in the main web configuration file, WEBSWP.CFG.

For example:

[ResourceLimit]
ValidationLimit=30

The ValidationLimit directive specifies the maximum number of MBytes WEBsweeper is permitted to use when storing files in memory. This does not include memory used for file disassembly. The default value is 30 (Mbytes), but this can be changed if desired.

When the combined file size of all the files being validated exceeds the validation limit, WEBsweeper will prevent files that qualify for progress messages from being downloaded. Instead a notice will be returned, indicating that the system resource limit will be exceeded.

If progress messages are disabled then the validation limit check will not be applied.

See page 7-14 for more details on progress messages.



[Top] [Prev] [Next] [Bottom]



1 Assuming that the content type of the resource matches a ContentType directive.

msw.support@mimesweeper.com

Copyright © 1998, Content Technologies Limited. All rights reserved.