Procedure: lex Purpose: Turns a string into a list of token structs with some basic processing performed, for the mini language. The tokens are generated by get_token. The processing performed is to remove blanks and check for and illegal token types(token types supported by IDL but not the mini language, like @statements) Inputs: s: the string to be tokenized Keywords: token_list: The token_list is returned through this variable error: If an error occurs, a struct describing it will be returned through this variable $LastChangedBy: pcruce $ $LastChangedDate: 2013-01-09 12:57:39 -0800 (Wed, 09 Jan 2013) $ $LastChangedRevision: 11408 $ $URL: svn+ssh://thmsvn@ambrosia.ssl.berkeley.edu/repos/spdsoft/trunk/general/mini/lex.pro $