Commit Graph
85 Commits
Author SHA1 Message Date
josh eee6513384 Remove outer namespacing class 2023-07-10 22:54:33 -04:00
josh 78ce7fb77a Replace 'ref' arguments with plain pointers 2023-07-10 22:40:03 -04:00
josh 1c50d37a3e Add Position struct to track text positions 2023-07-10 11:18:57 -04:00
josh 83a4037740 Return a lexer error on unexpected input - close #3 2023-07-08 10:36:58 -04:00
josh ecef933255 Consolidate return codes 2023-07-08 09:23:31 -04:00
josh 0232b204c6 Return integer result code from Parser.parse() 2023-07-08 08:52:21 -04:00
josh 8a377b4950 Just return integer result code from Lexer.lex_token() 2023-07-08 08:08:36 -04:00
josh d56cc2deeb Just return integer result code from Decoder.decode_code_point() 2023-07-05 16:54:52 -04:00
josh 9895733a05 Switch unit tests from gdc to ldc2 2023-06-29 19:16:36 -04:00
josh f402315201 Name internally generated tokens with double-underscore 2023-03-13 14:13:13 -04:00
josh b92679e0c2 Replace LexedToken with Result struct 2023-03-11 21:16:55 -05:00
josh b00f53050b Clean up Decoder result handling 2023-03-06 20:32:01 -05:00
josh e2100f6ccd Move JSON parser source to standalone file 2023-01-16 14:59:43 -05:00
josh dbc5560aec Add JSON parser test case 2022-11-14 23:07:10 -05:00
josh 62451f3a92 Allow multiple test files to be compiled 2022-11-14 21:00:49 -05:00
josh c6ea4f83c2 Store parser values according to the rule/pattern type 2022-11-13 22:20:30 -05:00
josh e4a160f918 Allow defining multiple parser types and assigning parser types to tokens and rules 2022-11-13 13:35:19 -05:00
josh 8dc27686aa Rename result_type to ptype, parser result to pvalue 2022-11-12 13:29:10 -05:00
josh bca0a14371 Allow storing a result value for a token from a lexer code block 2022-10-16 21:40:25 -04:00
josh ca8a360c0e Provide matched text to lexer user code block 2022-10-15 13:37:34 -04:00
josh 623c644e74 Work on real D strings instead of ubyte pointer and length
Also fix a couple UTF-8 decoder bugs!
2022-10-15 13:32:33 -04:00
josh de93d23585 Add test for non-LALR grammar failing to generate parser 2022-10-13 05:17:06 -04:00
josh ad09ff039a Add spec to test parsing lists 2022-10-13 05:02:05 -04:00
josh 727c8cd1ea Execute rule user code blocks when reducing the rule 2022-10-13 04:56:50 -04:00
josh 31970522de Store parse result; add result_type grammar keyword 2022-10-12 20:56:14 -04:00
josh 02be6de48e Add lexer modes and $mode() code expansion 2022-10-09 22:49:01 -04:00
josh b2d11321fe Add grammar syntax to specify lexer mode for tokens and patterns 2022-10-04 22:23:39 -04:00
josh 66d654b6b9 Add $token() user code block expansion 2022-10-02 10:43:47 -04:00
josh 43fb74fe4b Capture and verify stdout results from tests 2022-10-02 10:31:07 -04:00
josh 01ef4fc27c Rename some test files 2022-10-02 10:10:04 -04:00
josh f46b5b3f4d Remove TOKEN_EOF; define EOF token and start rule in Generator 2022-10-02 10:07:44 -04:00
josh 150be33826 Assign pattern code IDs in Generator instead of Grammar 2022-10-01 10:36:35 -04:00
josh e7e30c4f28 Add pattern statement 2022-09-30 21:05:18 -04:00
josh 04367db0ac Add forward slashes around patterns and parse more robustly 2022-09-28 23:05:01 -04:00
josh 4b148f3797 Add Grammar spec 2022-09-27 14:45:29 -04:00
josh a4c5546876 Disable parser debug output 2022-09-27 12:33:23 -04:00
josh 4d716f6c10 Remove Token#c_name; use given token case in token constants 2022-09-25 14:48:49 -04:00
josh 672098ad32 Execute user code blocks assigned to tokens 2022-09-24 17:31:40 -04:00
josh 38ae5ac7a1 Split Token class into Token/Pattern 2022-09-15 22:46:44 -04:00
josh bf075a69f6 Test matching a semicolon 2022-07-23 22:25:17 -04:00
josh b682c72b17 Add semicolon to end of all grammar statements 2022-07-23 22:09:19 -04:00
josh 382e17804c Test SLR grammar 2022-06-27 21:06:03 -04:00
josh 30f4cfcc99 Write parser log file
Fix bug of skipping rule set IDs.
Remove unneeded out_sets from ItemSet class.
2022-06-26 11:06:55 -04:00
josh 2fbe13e071 Do not consume lookahead token when reducing 2022-06-25 21:35:54 -04:00
josh f2cc5b112e Handle shifting states after reducing 2022-06-25 16:16:20 -04:00
josh 84c4a16ce6 Start on Parser.parse() 2022-06-21 23:03:00 -04:00
josh df8088c3c6 Clean up rule format in grammar files 2022-06-05 16:28:35 -04:00
josh ba74d0a20a Reduce maximum code point value to not interfere with magic code point values used by parser 2022-06-05 15:24:40 -04:00
josh fe607291f4 Use .propane extension for test grammars 2022-06-05 15:18:55 -04:00
josh f37801ec9e Store tokens and drop tokens separately 2022-06-05 14:36:19 -04:00