|
|
24fab8515d
|
Decoder.decode_code_point returns struct with code point and length together
|
2021-07-06 10:50:32 -04:00 |
|
|
|
1dcdd87a28
|
Generate token constants and names to top-level parser class
|
2021-07-06 10:28:35 -04:00 |
|
|
|
8aec7ec0de
|
Lexer class can be used standalone
|
2021-07-06 10:15:07 -04:00 |
|
|
|
748c219625
|
Do not return dropped tokens from Lexer.lex_token()
|
2021-07-05 22:53:58 -04:00 |
|
|
|
71ee7de9f9
|
Remove obsolete lex() and lex_token() methods
|
2021-07-05 22:49:50 -04:00 |
|
|
|
2121acc87e
|
Complete Lexer.lex_token()
|
2021-07-05 22:41:09 -04:00 |
|
|
|
f2563cf255
|
Work on Lexer.lex_token()
|
2021-07-05 22:02:27 -04:00 |
|
|
|
24d12be3b9
|
Add TOKEN enum entries for EOF, decode error, drop, and none
|
2021-07-05 20:11:55 -04:00 |
|
|
|
91d6ee25ea
|
Add Lexer class
|
2021-07-05 19:13:41 -04:00 |
|
|
|
2f1cb47bea
|
Add Decoder class to decode code points
|
2021-07-05 18:47:10 -04:00 |
|
|
|
651461c570
|
Start on decode_code_point()
|
2021-06-29 23:17:44 -04:00 |
|
|
|
3ce54bd303
|
Start on lex()/lex_token()
|
2021-06-29 23:10:40 -04:00 |
|
|
|
15454f926a
|
Add TokenNames array
|
2021-06-29 22:54:24 -04:00 |
|
|
|
aae7bc188c
|
Use unsigned literals
|
2021-06-26 18:11:20 -04:00 |
|
|
|
93cb25df62
|
Do not generate token names for drop tokens
|
2021-06-26 16:16:18 -04:00 |
|
|
|
10a8ef5eb4
|
Update generated lexer state and transition tables
|
2021-06-26 15:58:36 -04:00 |
|
|
|
98584ce07a
|
Add FA#build_tables
|
2021-06-24 15:06:10 -04:00 |
|
|
|
2122ca02fe
|
Start generating lexer states and transitions
|
2021-06-23 23:15:02 -04:00 |
|
|
|
5881f13380
|
Generate enum of token identifiers
|
2021-06-23 22:22:45 -04:00 |
|
|
|
d2fac07249
|
Add Generator class
|
2021-06-15 16:51:36 -04:00 |
|
|
|
07dd68e367
|
Write output file from ERB template
|
2021-05-01 16:44:01 -04:00 |
|
