home *** CD-ROM | disk | FTP | other *** search
/ ftp.cs.arizona.edu / ftp.cs.arizona.edu.tar / ftp.cs.arizona.edu / icon / historic / v941.tgz / icon.v941src.tar / icon.v941src / src / common / tokens.txt < prev    next >
Text File  |  2000-07-29  |  3KB  |  77 lines
  1. Primitive Tokens
  2.  
  3.    Token                Token Type      Flags
  4.  
  5.    identifier           IDENT            b e
  6.    integer-literal      INTLIT           b e
  7.    real-literal         REALLIT          b e
  8.    string-literal       STRINGLIT        b e
  9.    cset-literal         CSETLIT          b e
  10.    end-of-file          EOFX
  11.  
  12. Reserved Words
  13.  
  14.    Token                Token Type      Flags
  15.  
  16.    break                BREAK            b e
  17.    by                   BY
  18.    case                 CASE             b
  19.    create               CREATE           b
  20.    default              DEFAULT          b
  21.    do                   DO
  22.    else                 ELSE
  23.    end                  END              b
  24.    every                EVERY            b
  25.    fail                 FAIL             b e
  26.    global               GLOBAL
  27.    if                   IF               b
  28.    initial              INITIAL          b
  29.    invocable            INVOCABLE
  30.    link                 LINK
  31.    local                LOCAL            b
  32.    next                 NEXT             b e
  33.    not                  NOT              b
  34.    of                   OF
  35.    procedure            PROCEDURE
  36.    record               RECORD
  37.    repeat               REPEAT           b
  38.    return               RETURN           b e
  39.    static               STATIC           b
  40.    suspend              SUSPEND          b e
  41.    then                 THEN
  42.    to                   TO
  43.    until                UNTIL            b
  44.    while                WHILE            b
  45.  
  46. ``Operator'' tokens not used in standard unary/binary syntax, see op.txt.
  47.  
  48.    Token                Token Type      Flags
  49.  
  50.    (                    LPAREN           b
  51.    )                    RPAREN             e
  52.    +:                   PCOLON
  53.    ,                    COMMA
  54.    -:                   MCOLON
  55.    :                    COLON
  56.    ;                    SEMICOL
  57.    [                    LBRACK           b
  58.    ]                    RBRACK             e
  59.    {                    LBRACE           b
  60.    }                    RBRACE             e
  61.  
  62. tokens starting with $ are alternate spellings for some tokens
  63.  
  64.    $(                   LBRACE           b
  65.    $)                   RBRACE           e
  66.    $<                   LBRACK           b
  67.    $>                   RBRACK           e
  68.  
  69. Explanation of Flags
  70.  
  71.    b    indicates that the token may begin an expression.
  72.    e    indicates that the token may end an expression.
  73.  
  74.    These two flags are used for semicolon insertion.  If a line
  75.    ends with an "e" token, and the next token is a "b" token,
  76.    a semicolon is inserted between the two tokens.
  77.