 josh
|
06af7fbe3b
|
wip
|
2023-08-20 21:22:34 -04:00 |
|
|
josh
|
9760da4df4
|
wip
|
2023-08-20 21:19:34 -04:00 |
|
|
josh
|
35acdde09f
|
generates a parser specs passing
|
2023-08-20 20:49:24 -04:00 |
|
|
josh
|
aef5367378
|
Get test_lexer_unknown_character working for C
|
2023-08-20 18:43:33 -04:00 |
|
|
josh
|
36213d9e9c
|
wip
|
2023-08-20 17:25:48 -04:00 |
|
|
josh
|
7b1d903b00
|
wip
|
2023-08-20 16:58:02 -04:00 |
|
|
josh
|
59e8e0a095
|
wip
|
2023-08-20 16:56:00 -04:00 |
|
|
josh
|
dace12310a
|
wip
|
2023-08-20 16:53:54 -04:00 |
|
|
josh
|
c7185edef0
|
Add spec support for C tests
|
2023-08-20 16:38:35 -04:00 |
|
|
josh
|
9d2b3be20b
|
Determine output language by output file extension
|
2023-08-20 16:27:58 -04:00 |
|
|
josh
|
2b515e1a7a
|
wip
|
2023-08-20 16:13:18 -04:00 |
|
|
josh
|
4ffdea07bb
|
wip
|
2023-08-08 22:43:46 -04:00 |
|
|
josh
|
cdb6294f1f
|
wip
|
2023-08-06 11:49:26 -04:00 |
|
|
josh
|
48b4033ef2
|
wip
|
2023-08-02 21:36:43 -04:00 |
|
|
josh
|
fff9700f91
|
Report the unexpected token for P_UNEXPECTED_TOKEN returns - close #11
|
2023-07-28 15:42:18 -04:00 |
|
|
josh
|
fa7a781a5d
|
Update gems
|
2023-07-26 11:39:36 -04:00 |
|
|
josh
|
c4bcb465da
|
Remove std.stdio import and printing of unexpected tokens
|
2023-07-17 21:57:31 -04:00 |
|
|
josh
|
d39fa61af0
|
Remove D language reference from test names
|
2023-07-15 14:19:30 -04:00 |
|
|
josh
|
6333762414
|
Add user guide math expression example
|
2023-07-14 20:32:50 -04:00 |
|
|
josh
|
4942c76551
|
Show rule ID and rule set ID in reduce actions log section
|
2023-07-14 16:52:00 -04:00 |
|
|
josh
|
653b4e00f6
|
Add testutils module with assert_eq()
|
2023-07-14 15:48:44 -04:00 |
|
|
josh
|
5ce562cbc3
|
Allow configuring API prefix - close #9
|
2023-07-13 18:06:24 -04:00 |
|
|
josh
|
7d7929a358
|
Compact some of the table output
|
2023-07-12 19:51:35 -04:00 |
|
|
josh
|
424ddfe55a
|
Output position info for various error return codes - close #10
|
2023-07-12 19:22:44 -04:00 |
|
|
josh
|
ce22e3465b
|
Use consistent styling
Prefix public symbols with "p_".
User lowercase for all type aliases.
Clean up some comments.
|
2023-07-12 16:45:59 -04:00 |
|
|
josh
|
c7bca74d3e
|
Use symbol_id instead of token_id for shift table entries
|
2023-07-12 15:51:07 -04:00 |
|
|
josh
|
7a1b4064c1
|
Switch to new API - close #8
The new API is more C-like and will allow consistency across all future
supported language targets.
|
2023-07-12 15:46:13 -04:00 |
|
|
josh
|
e0e5e87338
|
Move public types to the top
|
2023-07-12 13:52:24 -04:00 |
|
|
josh
|
779ba052c1
|
Use P_SUCCESS instead of P_TOKEN
|
2023-07-11 15:43:15 -04:00 |
|
|
josh
|
eee6513384
|
Remove outer namespacing class
|
2023-07-10 22:54:33 -04:00 |
|
|
josh
|
78ce7fb77a
|
Replace 'ref' arguments with plain pointers
|
2023-07-10 22:40:03 -04:00 |
|
|
josh
|
ad768711ff
|
Use size_t to hold runtime object IDs and INVALID_ID
|
2023-07-10 22:32:33 -04:00 |
|
|
josh
|
a2338a8fca
|
Add ShiftID
|
2023-07-10 22:28:48 -04:00 |
|
|
josh
|
612eb12545
|
Add RuleID
|
2023-07-10 22:27:53 -04:00 |
|
|
josh
|
ef7488747c
|
Add StateID
|
2023-07-10 22:25:28 -04:00 |
|
|
josh
|
950fafc872
|
Add SymbolID
|
2023-07-10 22:17:54 -04:00 |
|
|
josh
|
9dbae78724
|
Add ReduceID type
|
2023-07-10 21:55:49 -04:00 |
|
|
josh
|
f973e9dc2c
|
Rename lexer and parser State structs to avoid conflicts
|
2023-07-10 11:21:45 -04:00 |
|
|
josh
|
1c50d37a3e
|
Add Position struct to track text positions
|
2023-07-10 11:18:57 -04:00 |
|
|
josh
|
80ac6c17f0
|
Replace Token struct with integer type
Replace _TOKEN_COUNT with INVALID_TOKEN_ID.
|
2023-07-09 22:35:02 -04:00 |
|
|
josh
|
6327bd1e96
|
Use plain integer type for UserCodeID
|
2023-07-08 17:01:54 -04:00 |
|
|
josh
|
36ad6e0d1b
|
Build Lexer and Parser tables upon construction
|
2023-07-08 16:52:58 -04:00 |
|
|
josh
|
ffd02c16d1
|
Add StateID; remove TransitionResult
|
2023-07-08 16:46:38 -04:00 |
|
|
josh
|
0a7938038b
|
Make RuleSet#id read-only
|
2023-07-08 11:17:11 -04:00 |
|
|
josh
|
6daca1e73f
|
Add INVALID_ID
|
2023-07-08 10:49:56 -04:00 |
|
|
josh
|
83a4037740
|
Return a lexer error on unexpected input - close #3
|
2023-07-08 10:36:58 -04:00 |
|
|
josh
|
ecef933255
|
Consolidate return codes
|
2023-07-08 09:23:31 -04:00 |
|
|
josh
|
0232b204c6
|
Return integer result code from Parser.parse()
|
2023-07-08 08:52:21 -04:00 |
|
|
josh
|
c88338698a
|
Store whether a state accepts, not whether it drops
|
2023-07-08 08:29:33 -04:00 |
|
|
josh
|
8a377b4950
|
Just return integer result code from Lexer.lex_token()
|
2023-07-08 08:08:36 -04:00 |
|
|
josh
|
0d0da49cd5
|
Just return integer result code from Lexer.find_longest_match()
|
2023-07-05 17:07:48 -04:00 |
|
|
josh
|
d56cc2deeb
|
Just return integer result code from Decoder.decode_code_point()
|
2023-07-05 16:54:52 -04:00 |
|
|
josh
|
9e33a32930
|
Store code_point_length in a ubyte
|
2023-07-05 16:45:03 -04:00 |
|
|
josh
|
02d99082b2
|
Allow switching on Decoder.Result
|
2023-07-04 12:49:54 -04:00 |
|
|
josh
|
9895733a05
|
Switch unit tests from gdc to ldc2
|
2023-06-29 19:16:36 -04:00 |
|
|
josh
|
11348ca351
|
Add FindLongestMatchResult
|
2023-06-04 21:14:07 -04:00 |
|
|
josh
|
6b0fb4cb12
|
Add return type for transition()
|
2023-06-03 20:38:42 -04:00 |
|
|
josh
|
b78827746a
|
Return a Token object from Lexer.user_code()
|
2023-03-17 20:24:48 -04:00 |
|
|
josh
|
ce80e00e60
|
Remove TOKEN_DECODE_ERROR
|
2023-03-17 20:01:55 -04:00 |
|
|
josh
|
01b45df1f9
|
Remove TOKEN_DROP
|
2023-03-17 19:58:54 -04:00 |
|
|
josh
|
ffccc659aa
|
Clean up Lexer.State a bit
|
2023-03-14 19:38:42 -04:00 |
|
|
josh
|
e432f62b05
|
Add UserCodeID struct to represent user code IDs
|
2023-03-13 21:56:18 -04:00 |
|
|
josh
|
058945e08b
|
Add Token struct with validity checks
|
2023-03-13 16:14:50 -04:00 |
|
|
josh
|
f402315201
|
Name internally generated tokens with double-underscore
|
2023-03-13 14:13:13 -04:00 |
|
|
josh
|
d10e982fc8
|
Reserve double-underscore identifiers for internal use
|
2023-03-13 14:12:12 -04:00 |
|
|
josh
|
64974cc1e2
|
Refactor some of Lexer.attempt_lex_token() into find_longest_match()
|
2023-03-12 21:19:03 -04:00 |
|
|
josh
|
b92679e0c2
|
Replace LexedToken with Result struct
|
2023-03-11 21:16:55 -05:00 |
|
|
josh
|
1af018b103
|
MatchInfo: store pointer to the accepting state rather than copying its fields
|
2023-03-09 20:16:57 -05:00 |
|
|
josh
|
aabb574fea
|
Use CodePoint type for code point values
|
2023-03-09 19:10:17 -05:00 |
|
|
josh
|
30004c571d
|
Use result type query methods on Decoder.Result
|
2023-03-09 19:04:15 -05:00 |
|
|
josh
|
b00f53050b
|
Clean up Decoder result handling
|
2023-03-06 20:32:01 -05:00 |
|
|
josh
|
2e5083d823
|
Add explicit base types to the enums
|
2023-03-06 19:58:24 -05:00 |
|
|
josh
|
7f844711d9
|
Start on more of the user guide
|
2023-02-28 20:53:31 -05:00 |
|
|
josh
|
e2100f6ccd
|
Move JSON parser source to standalone file
|
2023-01-16 14:59:43 -05:00 |
|
|
josh
|
3057173370
|
Update license copyright year
|
2023-01-04 20:43:25 -05:00 |
|
|
josh
|
90d08e3554
|
Add script to build distributable propane script
|
2023-01-04 20:43:25 -05:00 |
|
|
josh
|
f5756e9523
|
Add script to generate user guide HTML
|
2023-01-04 20:43:25 -05:00 |
|
|
josh
|
dbc5560aec
|
Add JSON parser test case
|
2022-11-14 23:07:10 -05:00 |
|
|
josh
|
62451f3a92
|
Allow multiple test files to be compiled
|
2022-11-14 21:00:49 -05:00 |
|
|
josh
|
2e48921bb1
|
Fix $n expansion for rules to use rule component ptype
|
2022-11-14 21:00:49 -05:00 |
|
|
josh
|
c6ea4f83c2
|
Store parser values according to the rule/pattern type
|
2022-11-13 22:20:30 -05:00 |
|
|
josh
|
e4a160f918
|
Allow defining multiple parser types and assigning parser types to tokens and rules
|
2022-11-13 13:35:19 -05:00 |
|
|
josh
|
8dc27686aa
|
Rename result_type to ptype, parser result to pvalue
|
2022-11-12 13:29:10 -05:00 |
|
|
josh
|
bca0a14371
|
Allow storing a result value for a token from a lexer code block
|
2022-10-16 21:40:25 -04:00 |
|
|
josh
|
ca8a360c0e
|
Provide matched text to lexer user code block
|
2022-10-15 13:37:34 -04:00 |
|
|
josh
|
623c644e74
|
Work on real D strings instead of ubyte pointer and length
Also fix a couple UTF-8 decoder bugs!
|
2022-10-15 13:32:33 -04:00 |
|
|
josh
|
de93d23585
|
Add test for non-LALR grammar failing to generate parser
|
2022-10-13 05:17:06 -04:00 |
|
|
josh
|
ad09ff039a
|
Add spec to test parsing lists
|
2022-10-13 05:02:05 -04:00 |
|
|
josh
|
727c8cd1ea
|
Execute rule user code blocks when reducing the rule
|
2022-10-13 04:56:50 -04:00 |
|
|
josh
|
74beaf7ed8
|
Store final parse result and give access with .result parser property
|
2022-10-12 21:33:09 -04:00 |
|
|
josh
|
31970522de
|
Store parse result; add result_type grammar keyword
|
2022-10-12 20:56:14 -04:00 |
|
|
josh
|
02be6de48e
|
Add lexer modes and $mode() code expansion
|
2022-10-09 22:49:01 -04:00 |
|
|
josh
|
b2d11321fe
|
Add grammar syntax to specify lexer mode for tokens and patterns
|
2022-10-04 22:23:39 -04:00 |
|
|
josh
|
6bd9d4a09b
|
Remove _TOKEN_NONE and use _TOKEN_COUNT instead
|
2022-10-03 21:40:34 -04:00 |
|
|
josh
|
ced5a56424
|
Support global user code blocks
|
2022-10-03 21:24:13 -04:00 |
|
|
josh
|
66d654b6b9
|
Add $token() user code block expansion
|
2022-10-02 10:43:47 -04:00 |
|
|
josh
|
43fb74fe4b
|
Capture and verify stdout results from tests
|
2022-10-02 10:31:07 -04:00 |
|
|
josh
|
01ef4fc27c
|
Rename some test files
|
2022-10-02 10:10:04 -04:00 |
|
|
josh
|
f46b5b3f4d
|
Remove TOKEN_EOF; define EOF token and start rule in Generator
|
2022-10-02 10:07:44 -04:00 |
|
|
josh
|
150be33826
|
Assign pattern code IDs in Generator instead of Grammar
|
2022-10-01 10:36:35 -04:00 |
|