NAME
TokeMem - tokenise a block of text into Blitz tokens
SYNOPSIS
tokeBlock = TokeMem(srcAscii,maxBlockSize);
UINT = TokeMem(char * srcAscii, UINT maxBlockSize);
FUNCTION
This command takes a block of ASCII text (with each line terminated by
a LF, ASCII code 10) and creates a block of tokenised lines. The length
of the block is specified in the function call.
INPUTS
srcAscii - a pointer to a LF terminated block of ASCII text
maxBlockSize - the size of memory to allocate to hold the tokenised text
RESULT
tokeBlock - a pointer to the tokenised text block (or NULL for failure)
SEE ALSO
DetokeMem()
converted with guide2html by Kochtopf