 josh
|
ffccc659aa
|
Clean up Lexer.State a bit
|
2023-03-14 19:38:42 -04:00 |
|
|
josh
|
e432f62b05
|
Add UserCodeID struct to represent user code IDs
|
2023-03-13 21:56:18 -04:00 |
|
|
josh
|
f402315201
|
Name internally generated tokens with double-underscore
|
2023-03-13 14:13:13 -04:00 |
|
|
josh
|
d10e982fc8
|
Reserve double-underscore identifiers for internal use
|
2023-03-13 14:12:12 -04:00 |
|
|
josh
|
b92679e0c2
|
Replace LexedToken with Result struct
|
2023-03-11 21:16:55 -05:00 |
|
|
josh
|
2e48921bb1
|
Fix $n expansion for rules to use rule component ptype
|
2022-11-14 21:00:49 -05:00 |
|
|
josh
|
c6ea4f83c2
|
Store parser values according to the rule/pattern type
|
2022-11-13 22:20:30 -05:00 |
|
|
josh
|
e4a160f918
|
Allow defining multiple parser types and assigning parser types to tokens and rules
|
2022-11-13 13:35:19 -05:00 |
|
|
josh
|
8dc27686aa
|
Rename result_type to ptype, parser result to pvalue
|
2022-11-12 13:29:10 -05:00 |
|
|
josh
|
bca0a14371
|
Allow storing a result value for a token from a lexer code block
|
2022-10-16 21:40:25 -04:00 |
|
|
josh
|
727c8cd1ea
|
Execute rule user code blocks when reducing the rule
|
2022-10-13 04:56:50 -04:00 |
|
|
josh
|
31970522de
|
Store parse result; add result_type grammar keyword
|
2022-10-12 20:56:14 -04:00 |
|
|
josh
|
02be6de48e
|
Add lexer modes and $mode() code expansion
|
2022-10-09 22:49:01 -04:00 |
|
|
josh
|
b2d11321fe
|
Add grammar syntax to specify lexer mode for tokens and patterns
|
2022-10-04 22:23:39 -04:00 |
|
|
josh
|
6bd9d4a09b
|
Remove _TOKEN_NONE and use _TOKEN_COUNT instead
|
2022-10-03 21:40:34 -04:00 |
|
|
josh
|
ced5a56424
|
Support global user code blocks
|
2022-10-03 21:24:13 -04:00 |
|
|
josh
|
66d654b6b9
|
Add $token() user code block expansion
|
2022-10-02 10:43:47 -04:00 |
|
|
josh
|
f46b5b3f4d
|
Remove TOKEN_EOF; define EOF token and start rule in Generator
|
2022-10-02 10:07:44 -04:00 |
|
|
josh
|
150be33826
|
Assign pattern code IDs in Generator instead of Grammar
|
2022-10-01 10:36:35 -04:00 |
|
|
josh
|
e7e30c4f28
|
Add pattern statement
|
2022-09-30 21:05:18 -04:00 |
|
|
josh
|
04367db0ac
|
Add forward slashes around patterns and parse more robustly
|
2022-09-28 23:05:01 -04:00 |
|
|
josh
|
1547528ecf
|
Split grammar statement parsing into separate methods
|
2022-09-27 18:49:04 -04:00 |
|
|
josh
|
62cb5c03f2
|
Refactor grammar parsing a bit
|
2022-09-27 15:28:39 -04:00 |
|
|
josh
|
48704295bb
|
Rename lexer state "accepts" to "token"
|
2022-09-25 14:57:46 -04:00 |
|
|
josh
|
4d716f6c10
|
Remove Token#c_name; use given token case in token constants
|
2022-09-25 14:48:49 -04:00 |
|
|
josh
|
672098ad32
|
Execute user code blocks assigned to tokens
|
2022-09-24 17:31:40 -04:00 |
|
|
josh
|
92ce30f354
|
Add tokenid keyword
|
2022-09-19 22:16:57 -04:00 |
|
|
josh
|
38ae5ac7a1
|
Split Token class into Token/Pattern
|
2022-09-15 22:46:44 -04:00 |
|
|
josh
|
b682c72b17
|
Add semicolon to end of all grammar statements
|
2022-07-23 22:09:19 -04:00 |
|
|
josh
|
30f4cfcc99
|
Write parser log file
Fix bug of skipping rule set IDs.
Remove unneeded out_sets from ItemSet class.
|
2022-06-26 11:06:55 -04:00 |
|
|
josh
|
f2cc5b112e
|
Handle shifting states after reducing
|
2022-06-25 16:16:20 -04:00 |
|
|
josh
|
84c4a16ce6
|
Start on Parser.parse()
|
2022-06-21 23:03:00 -04:00 |
|
|
josh
|
f17efe8c82
|
Add RuleSet#id to use when reducing
Parser will know what state to go to after reducing a Rule based on the
RuleSet ID.
Start on Parser class.
|
2022-06-21 20:07:27 -04:00 |
|
|
josh
|
60e2818075
|
Determine the reduce actions for each parser state
|
2022-06-17 01:45:48 -04:00 |
|
|
josh
|
5af3179ff2
|
Add RuleSet#start_token_set
|
2022-06-17 01:35:02 -04:00 |
|
|
josh
|
11ea02fb86
|
Determine the possibly-empty RuleSets
|
2022-06-17 01:35:02 -04:00 |
|
|
josh
|
8f38d0b017
|
Clean up ItemSet#close!
|
2022-06-17 01:35:02 -04:00 |
|
|
josh
|
a91bf2f250
|
Clean up parser ItemSet processing
|
2022-06-14 22:57:07 -04:00 |
|
|
josh
|
0f1c00d1a6
|
Add RuleSet#could_be_empty?
|
2022-06-14 07:35:58 -04:00 |
|
|
josh
|
291509f005
|
Add Rule#empty?
|
2022-06-14 07:35:38 -04:00 |
|
|
josh
|
c1769503a8
|
Add Item#complete?
|
2022-06-14 07:35:07 -04:00 |
|
|
josh
|
8b152abaa7
|
Add ItemSet#leading_item_sets
|
2022-06-14 07:34:35 -04:00 |
|
|
josh
|
d6e5c4325d
|
Add new start rule ending with EOF token rather than appending EOF token to all user-specified start rules
|
2022-06-07 22:25:31 -04:00 |
|
|
josh
|
2837dfda6b
|
Add Rule#id
|
2022-06-06 22:30:53 -04:00 |
|
|
josh
|
9d850294a9
|
Clean up and comment Item and ItemSet
|
2022-06-05 18:12:14 -04:00 |
|
|
josh
|
df8088c3c6
|
Clean up rule format in grammar files
|
2022-06-05 16:28:35 -04:00 |
|
|
josh
|
ba74d0a20a
|
Reduce maximum code point value to not interfere with magic code point values used by parser
|
2022-06-05 15:24:40 -04:00 |
|
|
josh
|
c42c3576a5
|
Remove RuleSet creation from Grammar
|
2022-06-05 15:16:41 -04:00 |
|
|
josh
|
ca6a93a4c5
|
Move generation logic to new Generator class
|
2022-06-05 14:57:58 -04:00 |
|
|
josh
|
b1d5cddab4
|
Change Token constructor to take a Hash of all parameters
|
2022-06-05 14:40:41 -04:00 |
|