home
***
CD-ROM
|
disk
|
FTP
|
other
***
search
/
OS/2 Shareware BBS: 35 Internet
/
35-Internet.zip
/
wwwgrab1.zip
/
wwwgrab2.doc
< prev
Wrap
Text File
|
1996-10-14
|
6KB
|
187 lines
Welcome to WWWGrab/2 v 1.0
WWWGrab/2 is an utility for mirroring complete websites.
WWWGrab/2 Requirements:
OS/2 Version 2.11 or greater. OS/2 Warp Connect suggested for best
performance.
One of the following TCP/IP packages for OS/2. (Listed in order
of preference.)
- IBM TCP/IP 3.0 included in OS/2 Warp Connect.
- IBM TCP/IP 2.0 Base Kit with CSD64092 or greater applied.
- The Internet Access Kit from OS/2 Warp's Bonus pack.
A disk with longnames support!!
To start WWWGrab/2 simply type at the OS/2 command prompt:
WWWGRAB2 <config_file> [URL]
The URL must be in the "http form", i.e. http://blah.blah.blah... Config
file must be plain text file. The easiest way to create a config file is to
copy one of the demofiles and adjust it to your needs. I've included the files
I use it for testing. Below you find an overview of the parameters as they
should be in the config file.
URL <url-in-the-http-form>
The complete URL of the site you want to mirror. Http is required!
Example: URL http://www.vr.net/~pepsi/helloween/index.html
LOCALPATH <path>
This is the path on your local machine under which the directory
structure will be created.
Example: LOCALPATH F:\GRAB\IBM\
$ EXTENSIONS <list of extensions>
Extensions defines a list of file extension search strings which have to
be processed. The extensions are seperated by a space. HTM, HTML are
already implied. Be carefull what you put here. EXE or ZIP as extension
could mean that you start copying complete HOBBES! You may use the ':'
char as 'NOT' operator.
Example: EXTENSIONS JPG GIF WAV AU
EXTENSIONS :JPG :GIF -> All, except JPG and GIF files
[Shareware version has hardcoded following extensions: HTM, HTML, JPG,
GIF, WAV, AU]
MAXDEEP <levels>
MaxDeep defines how many levels deep you want to mirror. Pages which are
lower in the tree are ignored.
Example: MAXDEEP 5
[Shareware version is limited to max. 5 levels]
MAXTRIES <num>
MaxTries defines the number of attempts for getting a file. WWWGrab/2
tries to grab all the files. If a file isn't retrieved, it's ignored
until the complete list has been processed. Then WWWGrab/2 checks if
there are missing files and starts to retry those. This process is
repeated until all the files are retrieved or MAXTRIES times.
Example: MAXTRIES 3
$ DEFAULTNAME <name>
Sometimes links point to a directory instead of a file. If is not know
filename, the DefaultName is used.
Example: DEFAULTNAME Welcome.htm
ALL
Normaly, if WWWGrab/2 sees that a file already exists, it will send a
conditional GET to the remote server. The file is only send back when
it's newer than the local file. This behaviour is default. If you want to
update all the files regardless dates and local existance, you should use
ALL.
Example: ALL
$ CHANGESITE <num sites>
Normaly, if WWWGrab/2 found in HTM* file link to the another WWW server,
is ignored. If you want allow change the WWW server, you should use
CHANGESITE. Default is 0 - DON'T change site. BE CAREFULL which number
you enter here! You may start mirror complete WWW! In the next version
will be List_Of_Allowed_Sites.
Example: CHANGESITE 0
$ -> Registered version only.
Disclaimer etc.
===============
This program is COPYRIGHTED by J. Rubes.
WWWGrab/2 is a shareware product. It is distributed through public access
channels so that perspective buyers can have the opportunity to evaluate the
product before making a decision to buy.
WWWGrab/2 may be used only for legal purposes. CHECK if you are allowed
to mirror a site.
USE AT YOUR OWN RISK
This program is provided AS IS without any warranty, expressed or
implied, including but not limited to fitness for a particular use. The user
is responsible for the results of correct or incorrect usage of this software.
WWWGrab/2 may not be used to provide commercial services without written
permission of the author.
If you like this program, please:
Send me $10.00, the normal user fee for WWWGrab/2. You may send more:-)
For this you will recieve (via email) a registered personalised copy of
the most recent version of WWGrab/2. This registration makes all subsequent
versions possible free of charge.
If you don't like this program:
Delete it.
If you wanna crack it:
Ask me how:-)
------------------------------8<----------------------------------------------
REGISTRATION FORM
You sending me $__. (Minimum is $10).
Your REAL name:_________________________________________________________
Your email address:_____________________________________________________
Date:__/__/____
Signature:______________________________________
I'm sorry, but I may accept only paper money enclosed with this
registration form. No credit cards, nor checks:-(
Please enclose paper money with this form between thick paper to make it
impossible to see it from outside the envelope.
Thanx
Please post this registration form and enclosed money to:
Jiri Rubes
E. Benese 9/15
Prostejov
796 03
CZECH REPUBLIC
------------------------------8<----------------------------------------------
Conatct:
Remember that software of this kind lives or dies by the response I get.
You may send comments, suggestions, bugs, etc. to:
email:
Jiri_Rubes@slad.fido.cz
FidoNet:
2:421/37