064bb94108token data protected again by default now
Josh Holtrop
2010-06-01 11:53:42 -04:00
b689923475user data in "public" section by default now; storing list of tokens in the generated parser for use later by the rules
Josh Holtrop
2010-05-21 11:05:26 -04:00
dfbd319329fixed build test sscanf() arg order
Josh Holtrop
2010-05-21 10:48:46 -04:00
9055f591f9execute test after building it
Josh Holtrop
2010-05-21 10:27:27 -04:00
3cdaa2e338bugfix -- create Matches with longest_match_ovector not the temporary ovector
Josh Holtrop
2010-05-21 10:27:16 -04:00
3a3dc4074badded Token::m_type/setType()/getType(); changed Token::process() to accept a const reference to a Matches; updated build test
Josh Holtrop
2010-05-21 10:22:37 -04:00
3f3dd81e67added TokenDefinition::getIdentifier() and replacement buildToken
Josh Holtrop
2010-05-21 09:46:17 -04:00
c6cc8e57d1added token classes and token class process() methods to Imbecile-generated parser
Josh Holtrop
2010-05-20 17:08:03 -04:00
449a510671re-worked defines in generated parser; writing TK_ #define's for token types now
Josh Holtrop
2010-05-20 15:59:06 -04:00
4ec500a2fbadded token_data and token_code replacements for global Token information; added debug message for missing replacements
Josh Holtrop
2010-05-20 15:27:08 -04:00
62fd96ad9bupdated replacement system
Josh Holtrop
2010-05-19 16:50:36 -04:00
ecfa1730f5created replacement system for templates ("{%word%}" syntax)
Josh Holtrop
2010-05-19 16:14:04 -04:00
55b1e1494arenamed MatchSet to Matches
Josh Holtrop
2010-05-19 14:30:15 -04:00
c0e88f5c6fchanged token list to a STL list instead of a vector
Josh Holtrop
2010-05-19 12:20:50 -04:00
762ff3d561added data gathering; changed the way gathering was done (now ${...$} and %{...%}); added continue_line in parseInputFile()
Josh Holtrop
2010-05-19 12:00:06 -04:00
b90b83ab0frenamed "ignored" flag to "process" in token definitions
Josh Holtrop
2010-05-18 14:22:11 -04:00
953796ec23refactored into Parser::buildTokenList()
Josh Holtrop
2010-05-17 16:26:42 -04:00
89a414ff93added "ignored" flag in TokenDefinition, parsing token flags now
Josh Holtrop
2010-05-17 15:32:27 -04:00
593c0d6cb6including refptr in compiler include path; added split() and trim() in TokenDefinition.cc
Josh Holtrop
2010-05-17 15:24:35 -04:00
9d6ede6106added refptr into tmpl/parser.h, added Node and Token classes to be generated
Josh Holtrop
2010-05-17 15:13:22 -04:00
2d563b9ea4updated build test Makefile
Josh Holtrop
2010-05-15 00:51:43 -04:00
96010ea9aelexer working with pcre, not building any objects for handling tokens yet
Josh Holtrop
2010-05-15 00:43:55 -04:00
25888fe55abuilding tmpl.h before dependency files
Josh Holtrop
2010-05-14 22:30:48 -04:00
edeb857c77added I_TOKENLIST definition; build test now compiling
Josh Holtrop
2010-05-11 16:33:22 -04:00
b27a900b96Parser::write() returning status; main() catching errors from Parser::parseInputFile() and Parser::write()
Josh Holtrop
2010-05-11 15:14:56 -04:00
3a8d9ca55dtoken matching loop storing ovector for longest match so the longest-matching token does not need to be re-matched to obtain subpattern match strings
Josh Holtrop
2010-05-07 15:24:50 -04:00
1113cdb7d2parse() calling pcre_exec() to try to match tokens
Josh Holtrop
2010-05-07 14:37:15 -04:00
67c051c866expanded parse() to compile all tokens, ready to match them
Josh Holtrop
2010-05-07 13:07:21 -04:00
8cc4edfca3adding NUL byte to file read in parser
Josh Holtrop
2010-05-06 15:44:40 -04:00
44bf780a42added read_istream() in tmpl/parser.cc
Josh Holtrop
2010-05-05 15:13:57 -04:00
bfc4fc59c7generated parse() returns bool status
Josh Holtrop
2010-05-04 16:12:55 -04:00