336 Commits

Author SHA1 Message Date
fbd215098b Update license years 2022-05-27 21:49:54 -04:00
bfe2916165 Update bundler 2022-05-27 00:15:03 -04:00
c9bc4832f4 bundle update 2022-05-27 00:14:26 -04:00
6dfef8573f Fix ERB constructor call for Ruby 3.2 warnings 2022-05-27 00:12:40 -04:00
f3ed678fe1 Store tokens in Hash by name 2021-09-27 21:40:12 -04:00
280b749e38 Track Rule IDs 2021-09-27 21:29:44 -04:00
d6779aef00 Start on Parser#build_tables 2021-09-22 23:26:36 -04:00
746ec89be8 Add test for a rule that can be arrived at from multiple states 2021-09-21 21:40:11 -04:00
997f34a1e4 Keep track of item set in-links 2021-09-21 21:32:18 -04:00
a2795bb531 Keep track of follow item sets by symbol for each item set 2021-09-21 17:09:53 -04:00
850e639e3a update identical rule spec to use lookahead symbol 2021-09-06 20:18:17 -04:00
5f7e548fe3 Remove Rule::Pattern, Item stores a Rule reference 2021-09-06 19:41:29 -04:00
bdb10e7afc test duplicate rules 2021-09-05 09:50:04 -04:00
7bdaf7cdbc Do not create item set following EOF token 2021-09-05 07:51:59 -04:00
08e3516ad9 Add wikipedia LR(0) parser example test 2021-09-04 22:33:34 -04:00
2c8f3c6e9a Avoid infinite loop with self-referential rules 2021-09-04 22:29:10 -04:00
9dffa3c41a Recursively build item sets 2021-08-29 12:38:44 -04:00
ceb7e9ee32 Add EOF token to Start rule patterns 2021-08-29 11:48:49 -04:00
6026bf1514 Start building following item sets 2021-08-29 09:41:00 -04:00
9cc1890ddc One Rule object stores all alternative patterns 2021-08-28 10:28:50 -04:00
e4f2fffe50 add Item#closed_items 2021-08-28 09:47:01 -04:00
d931bcb513 Do not expand rules 2021-08-28 09:23:08 -04:00
2e16b0bd6e Start on Item and ItemSet 2021-08-28 09:02:19 -04:00
6ce94e15af Expand rules 2021-08-28 08:11:06 -04:00
3f92ae46c4 Map rule components to Token/Rule references 2021-08-22 21:21:41 -04:00
00016f16b3 Combine Grammar and Generator into top-level Imbecile class 2021-08-22 21:04:46 -04:00
9273bfccf6 Move Token/Rule out of Grammar class 2021-08-19 20:00:40 -04:00
f295acb593 Generator builds a Lexer, not a Lexer::DFA 2021-08-19 13:11:12 -04:00
51a31317a6 Move FA#build_tables to Lexer::DFA 2021-08-19 11:55:34 -04:00
9459883e74 Add Lexer class; Move LexerDFA to Lexer::DFA 2021-08-18 17:09:45 -04:00
28591907c1 Move FA class out of Regex class 2021-08-18 17:05:03 -04:00
37d6917b49 Rework Rule constructor 2021-07-27 21:22:46 -04:00
2685c05360 Change rule syntax 2021-07-19 21:55:08 -04:00
c0c3353fd7 Test lexing empty null string returns EOF 2021-07-06 12:06:07 -04:00
3158e51059 Add length field to LexedToken 2021-07-06 11:59:35 -04:00
d9e4f64d2e Fix returning TOKEN_EOF when lexing at EOF 2021-07-06 11:55:44 -04:00
ec2dcf9a72 Fix not progressing through input while lexing a token 2021-07-06 11:47:33 -04:00
578e165e2d Fix off-by-one error in state IDs 2021-07-06 11:44:03 -04:00
e8df4296cc Begin testing lexer 2021-07-06 11:09:39 -04:00
230c324209 Fix iterating through all transitions in a state 2021-07-06 11:09:13 -04:00
1271e19b50 Test multi-byte code point decoding 2021-07-06 11:02:43 -04:00
12e11399af Add decoder tests 2021-07-06 10:57:06 -04:00
24fab8515d Decoder.decode_code_point returns struct with code point and length together 2021-07-06 10:50:32 -04:00
1dcdd87a28 Generate token constants and names to top-level parser class 2021-07-06 10:28:35 -04:00
8aec7ec0de Lexer class can be used standalone 2021-07-06 10:15:07 -04:00
c96d55b031 Fix class name 2021-07-06 10:14:14 -04:00
ca7d4862f9 Run test executable; build with unit tests 2021-07-06 10:03:42 -04:00
3c874ae4c1 Compile generated parser with a test file 2021-07-05 23:05:55 -04:00
748c219625 Do not return dropped tokens from Lexer.lex_token() 2021-07-05 22:53:58 -04:00
71ee7de9f9 Remove obsolete lex() and lex_token() methods 2021-07-05 22:49:50 -04:00