176 Commits

Author SHA1 Message Date
aef5367378 Get test_lexer_unknown_character working for C 2023-08-20 18:43:33 -04:00
dace12310a wip 2023-08-20 16:53:54 -04:00
9d2b3be20b Determine output language by output file extension 2023-08-20 16:27:58 -04:00
4942c76551 Show rule ID and rule set ID in reduce actions log section 2023-07-14 16:52:00 -04:00
5ce562cbc3 Allow configuring API prefix - close #9 2023-07-13 18:06:24 -04:00
ce22e3465b Use consistent styling
Prefix public symbols with "p_".
User lowercase for all type aliases.
Clean up some comments.
2023-07-12 16:45:59 -04:00
c7bca74d3e Use symbol_id instead of token_id for shift table entries 2023-07-12 15:51:07 -04:00
7a1b4064c1 Switch to new API - close #8
The new API is more C-like and will allow consistency across all future
supported language targets.
2023-07-12 15:46:13 -04:00
950fafc872 Add SymbolID 2023-07-10 22:17:54 -04:00
80ac6c17f0 Replace Token struct with integer type
Replace _TOKEN_COUNT with INVALID_TOKEN_ID.
2023-07-09 22:35:02 -04:00
36ad6e0d1b Build Lexer and Parser tables upon construction 2023-07-08 16:52:58 -04:00
ffd02c16d1 Add StateID; remove TransitionResult 2023-07-08 16:46:38 -04:00
0a7938038b Make RuleSet#id read-only 2023-07-08 11:17:11 -04:00
c88338698a Store whether a state accepts, not whether it drops 2023-07-08 08:29:33 -04:00
8a377b4950 Just return integer result code from Lexer.lex_token() 2023-07-08 08:08:36 -04:00
b78827746a Return a Token object from Lexer.user_code() 2023-03-17 20:24:48 -04:00
ce80e00e60 Remove TOKEN_DECODE_ERROR 2023-03-17 20:01:55 -04:00
01b45df1f9 Remove TOKEN_DROP 2023-03-17 19:58:54 -04:00
ffccc659aa Clean up Lexer.State a bit 2023-03-14 19:38:42 -04:00
e432f62b05 Add UserCodeID struct to represent user code IDs 2023-03-13 21:56:18 -04:00
f402315201 Name internally generated tokens with double-underscore 2023-03-13 14:13:13 -04:00
d10e982fc8 Reserve double-underscore identifiers for internal use 2023-03-13 14:12:12 -04:00
b92679e0c2 Replace LexedToken with Result struct 2023-03-11 21:16:55 -05:00
2e48921bb1 Fix $n expansion for rules to use rule component ptype 2022-11-14 21:00:49 -05:00
c6ea4f83c2 Store parser values according to the rule/pattern type 2022-11-13 22:20:30 -05:00
e4a160f918 Allow defining multiple parser types and assigning parser types to tokens and rules 2022-11-13 13:35:19 -05:00
8dc27686aa Rename result_type to ptype, parser result to pvalue 2022-11-12 13:29:10 -05:00
bca0a14371 Allow storing a result value for a token from a lexer code block 2022-10-16 21:40:25 -04:00
727c8cd1ea Execute rule user code blocks when reducing the rule 2022-10-13 04:56:50 -04:00
31970522de Store parse result; add result_type grammar keyword 2022-10-12 20:56:14 -04:00
02be6de48e Add lexer modes and $mode() code expansion 2022-10-09 22:49:01 -04:00
b2d11321fe Add grammar syntax to specify lexer mode for tokens and patterns 2022-10-04 22:23:39 -04:00
6bd9d4a09b Remove _TOKEN_NONE and use _TOKEN_COUNT instead 2022-10-03 21:40:34 -04:00
ced5a56424 Support global user code blocks 2022-10-03 21:24:13 -04:00
66d654b6b9 Add $token() user code block expansion 2022-10-02 10:43:47 -04:00
f46b5b3f4d Remove TOKEN_EOF; define EOF token and start rule in Generator 2022-10-02 10:07:44 -04:00
150be33826 Assign pattern code IDs in Generator instead of Grammar 2022-10-01 10:36:35 -04:00
e7e30c4f28 Add pattern statement 2022-09-30 21:05:18 -04:00
04367db0ac Add forward slashes around patterns and parse more robustly 2022-09-28 23:05:01 -04:00
1547528ecf Split grammar statement parsing into separate methods 2022-09-27 18:49:04 -04:00
62cb5c03f2 Refactor grammar parsing a bit 2022-09-27 15:28:39 -04:00
48704295bb Rename lexer state "accepts" to "token" 2022-09-25 14:57:46 -04:00
4d716f6c10 Remove Token#c_name; use given token case in token constants 2022-09-25 14:48:49 -04:00
672098ad32 Execute user code blocks assigned to tokens 2022-09-24 17:31:40 -04:00
92ce30f354 Add tokenid keyword 2022-09-19 22:16:57 -04:00
38ae5ac7a1 Split Token class into Token/Pattern 2022-09-15 22:46:44 -04:00
b682c72b17 Add semicolon to end of all grammar statements 2022-07-23 22:09:19 -04:00
30f4cfcc99 Write parser log file
Fix bug of skipping rule set IDs.
Remove unneeded out_sets from ItemSet class.
2022-06-26 11:06:55 -04:00
f2cc5b112e Handle shifting states after reducing 2022-06-25 16:16:20 -04:00
84c4a16ce6 Start on Parser.parse() 2022-06-21 23:03:00 -04:00