Generic Token Type
From Gallium
The Generic Token Type is made to be used in conjunction with the Generic Lexer.
Thus we just give the type declaration:
type camlp4_token = | KEYWORD of string | SYMBOL of string | LIDENT of string | UIDENT of string | ESCAPED_IDENT of string | INT of int * string | INT32 of int32 * string | INT64 of int64 * string | NATIVEINT of nativeint * string | FLOAT of float * string | CHAR of char * string | STRING of string * string | LABEL of string | OPTLABEL of string | QUOTATION of quotation | ANTIQUOT of string * string | COMMENT of string | BLANKS of string | NEWLINE | LINE_DIRECTIVE of int * option string | EOI