Repository navigation

Replace Prism action lexing with a Ruby scanner - #3

Merged

katsyoshi merged 157 commits into

mainfrom

replace-prism-with-action-lexer

Sep 13, 2026

Merged

Replace Prism action lexing with a Ruby scanner#3
katsyoshi merged 157 commits into
mainfrom
replace-prism-with-action-lexer

Commits on Sep 10, 2026
- Replace Prism action lexing with a Ruby scanner
  katsyoshi
  committed
  77feb29
- Expand action scanner to general Ruby source
  katsyoshi
  committed
  523f479
- Add local Rails lexer health snapshot
  katsyoshi
  committed
  27eaabe
- Improve Ruby source scanning for Rails
  katsyoshi
  committed
  b30fd94
- Handle keyword argument labels in Ruby lexer
  katsyoshi
  committed
  869f9f1
- Recognize percent literals after calls
  katsyoshi
  committed
  9e1d5b5
- Support interpolated Ruby symbols
  katsyoshi
  committed
  280041d
- Distinguish shifts from heredocs
  katsyoshi
  committed
  3711dc4
- Handle operator methods and call-site heredocs
  katsyoshi
  committed
  ce3715a
- Support Ruby operator globals and backreferences
  katsyoshi
  committed
  42bda35
- Allow non-ASCII percent literal delimiters
  katsyoshi
  committed
  aa24988
- Disambiguate percent operators from literals
  katsyoshi
  committed
  701eab9
- Disambiguate compressed shifts from heredocs
  katsyoshi
  committed
  1db3a62
- Disambiguate percent operators from percent literals
  katsyoshi
  committed
  a5f181e
- Stop scanning Ruby source at __END__
  katsyoshi
  committed
  cde4f4a
- Avoid treating shifts after variables as heredocs
  katsyoshi
  committed
  29611e9
- Require a delimiter boundary for heredocs
  katsyoshi
  committed
  2e75791
Commits on Sep 12, 2026
- Add Ruby source lexer literal support
  katsyoshi
  committed
  5cd547d
- Improve Ruby heredoc lexing
  katsyoshi
  committed
  ddadf42
- Improve lexer handling for Rails syntax
  katsyoshi
  committed
  c0cba0e
- Classify Ruby splat and block arguments
  katsyoshi
  committed
  0441a61
- Improve Ruby constant and operator lexing
  katsyoshi
  committed
  4dacb8f
- Recognize qualified operator methods
  katsyoshi
  committed
  274bd80
- Handle argumentless Ruby command blocks
  katsyoshi
  committed
  7634890
- Handle Ruby brace blocks
  katsyoshi
  committed
  b6563aa
- Lex Ruby setter method names
  katsyoshi
  committed
  6fdf731
- Lex keyword methods after receivers
  katsyoshi
  committed
  c7965ec
- Disambiguate endless method definitions
  katsyoshi
  committed
  1115676
- Avoid synthetic blocks after shifts
  katsyoshi
  committed
  746df88
- Test block context after shifts
  katsyoshi
  committed
  001f59f
- Prefer longest Ruby operators
  katsyoshi
  committed
  e89db08
- Lex Ruby argument forwarding
  katsyoshi
  committed
  8cef693
- Distinguish Ruby indexing brackets
  katsyoshi
  committed
  7c1c488
- Handle variable-shaped Ruby symbols
  katsyoshi
  committed
  06f305b
- Handle empty Ruby subclasses
  katsyoshi
  committed
  7b6b0b5
- Keep predicate calls in expression context
  katsyoshi
  committed
  aee0180
- Lex Ruby operator call parentheses
  katsyoshi
  committed
  1063544
- Lex forwarded Ruby arguments after commas
  katsyoshi
  committed
  52fb02a
- Lex explicit super calls
  katsyoshi
  committed
  a55292b
- Fix qualified class path actions
  katsyoshi
  committed
  829bf07
- Normalize Ruby argument lists
  katsyoshi
  committed
  22adc0d
- Lex do after parenthesized calls
  katsyoshi
  committed
  631a3c7
- Ignore newlines after logical operators
  katsyoshi
  committed
  073afc1
- Lex symbols after predicate identifiers
  katsyoshi
  committed
  44771ed
- Lex brace blocks after parenthesized calls
  katsyoshi
  committed
  e7735c9
- Lex lambda bodies after argument lists
  katsyoshi
  committed
  da4a375
- Normalize splat argument lists
  katsyoshi
  committed
  64102e1
- Lex escaped line continuations
  katsyoshi
  committed
  4f442c9
- Resolve block argument grammar conflict
  katsyoshi
  committed
  cfe6cd5
- Lex receiver method brace blocks
  katsyoshi
  committed
  efe46da
- Accept block calls after argument lists
  katsyoshi
  committed
  7bca933
- Lex ampersand operator symbols
  katsyoshi
  committed
  3a0a3a5
- Lex modifiers after control keywords
  katsyoshi
  committed
  11e55b1
- Lex operator method symbols
  katsyoshi
  committed
  0fda7cf
- Lex bitwise assignment operators
  katsyoshi
  committed
  85c3533
- Avoid synthetic blocks after keyword values
  katsyoshi
  committed
  dd73bc3
- Lex setter symbols
  katsyoshi
  committed
  73c735f
- Preserve newlines before Ruby terminators
  katsyoshi
  committed
  bbe897e
- Preserve heredoc suffix tokens
  katsyoshi
  committed
  1026049
- Ignore newlines after operator assignments
  katsyoshi
  committed
  5793476
- Preserve newlines after heredocs
  katsyoshi
  committed
  cefa56c
- Preserve newlines in synthetic blocks
  katsyoshi
  committed
  4e9b68f
- Preserve newlines in brace blocks
  katsyoshi
  committed
  b540e4d
- Lex class variables
  katsyoshi
  committed
  4ae0693
- Continue method chains after newlines
  katsyoshi
  committed
  45841f4
- Lex spaced ternary colons
  katsyoshi
  committed
  5108fb1
- Preserve newlines in lambda blocks
  katsyoshi
  committed
  3e8b36e
- Lex punctuation global variables
  katsyoshi
  committed
  9f3affc
- Distinguish modulo from percent literals
  katsyoshi
  committed
  920b1e5
- Lex percent regexp flags
  katsyoshi
  committed
  fd079d3
- Lex parenthesized yield arguments
  katsyoshi
  committed
  a33a524
- Reset conditional do context at newlines
  katsyoshi
  committed
  9c178f1
- Recognize modifiers after block endings
  katsyoshi
  committed
  f8a710b
- Lex quoted hash labels
  katsyoshi
  committed
  118798f
- Lex unary operator symbols
  katsyoshi
  committed
  e5184d7
- Lex slash operator method definitions
  katsyoshi
  committed
  b67095c
- Preserve receiver calls and interpolated strings
  katsyoshi
  committed
  3df56b1
- Classify spaced empty brackets as arrays
  katsyoshi
  committed
  2307d71
- Preserve do block calls in Ruby AST
  katsyoshi
  committed
  599168d
- Recognize spaced array command arguments
  katsyoshi
  committed
  397db84
- Preserve interpolation in percent strings and heredocs
  katsyoshi
  committed
  13e9201
- Handle interpolated regular expression literals
  katsyoshi
  committed
  c47dd7c
- Accept interpolated symbol literals
  katsyoshi
  committed
  798507b
- Finish lexer interpolation edge cases
  katsyoshi
  committed
  00e3525
- Build interpolated dynamic symbols
  katsyoshi
  committed
  d95f6f1
- Continue lines after bitwise ampersand
  katsyoshi
  committed
  b4bb278
- Handle bitwise operator line continuations
  katsyoshi
  committed
  5d5229c
- Continue lines after splat arguments
  katsyoshi
  committed
  f05ad4c
- Continue lines after range operators
  katsyoshi
  committed
  530bc57
- Continue lines after keyword logic operators
  katsyoshi
  committed
  72aafdd
- Preserve line continuations for operator tokens
  katsyoshi
  committed
  7d848f9
- Continue lines after not operator
  katsyoshi
  committed
  42b9602
- Continue lines after lambda and scope operators
  katsyoshi
  committed
  4aee3ca
- Refactor Ruby lexer lexical context
  katsyoshi
  committed
  5f09ba3
- Refine command block context after labels
  katsyoshi
  committed
  2fc4d85
- Improve Ruby block AST actions and lexical context
  katsyoshi
  committed
  33a7860
Commits on Sep 13, 2026
- Track command start in Ruby lexical context
  katsyoshi
  committed
  b93cee9
- Record Ruby lexer state transitions
  katsyoshi
  committed
  29eee8f
- Track hash delimiters in Ruby lexer context
  katsyoshi
  committed
  f119590
- Balance Ruby conditional lexer context
  katsyoshi
  committed
  c2cd1af
- Track command argument delimiters in lexer context
  katsyoshi
  committed
  2ef89d1
- Track Ruby block nesting in lexer context
  katsyoshi
  committed
  90c1e3a
- Track command brace blocks in lexer context
  katsyoshi
  committed
  a613bdb
- Track Ruby method name lexical state
  katsyoshi
  committed
  8266878
- Track Ruby label lexical states
  katsyoshi
  committed
  d96eb79
- Expose generated parser state traces
  katsyoshi
  committed
  7fe286e
- Preserve UTF-8 character literals in Ruby lexer
  katsyoshi
  committed
  0a52751
- Use regular do tokens for argumentless blocks
  katsyoshi
  committed
  f271949
- Use real brace tokens for argumentless blocks
  katsyoshi
  committed
  ffa54b7
- Classify brace blocks by call context
  katsyoshi
  committed
  3dae457
- Track Ruby method and lambda scopes
  katsyoshi
  committed
  7226978
- Preserve command brace token compatibility
  katsyoshi
  committed
  1b734b2
- Preserve command brace block AST
  katsyoshi
  committed
  b9afffe
- Recognize command argument percent literals
  katsyoshi
  committed
  fa93e4a
- Classify beginless range tokens
  katsyoshi
  committed
  27ea152
- Keep double dollar globals intact
  katsyoshi
  committed
  e0b0d79
- Classify nested call brace blocks
  katsyoshi
  committed
  29bc465
- Preserve assignment brace block chains
  katsyoshi
  committed
  f7f4633
- Connect parser events to lexical context
  katsyoshi
  committed
  f80cea8
- Expose parser lookahead state
  katsyoshi
  committed
  32ac838
- Track parser delimiter and block stacks
  katsyoshi
  committed
  6392a5d
- Track parser conditional stack
  katsyoshi
  committed
  8dfe7c3
- Track parser lexical scopes
  katsyoshi
  committed
  9b05cf8
- Classify call braces inside arguments
  katsyoshi
  committed
  04ee7d7
- Classify method body array literals
  katsyoshi
  committed
  877ae99
- Classify ternary branch brace blocks
  katsyoshi
  committed
  4692ce0
- Keep load path global intact
  katsyoshi
  committed
  228a854
- Classify keyword-shaped method names in definitions
  katsyoshi
  committed
  72ff469
- Handle multiple heredocs on one line
  katsyoshi
  committed
  0d6242b
- Recognize ampersand operator method names
  katsyoshi
  committed
  732541f
- Avoid synthetic ampersands after block arguments
  katsyoshi
  committed
  efee505
- Preserve newlines after nested blocks
  katsyoshi
  committed
  a15943d
- Preserve block terminator newlines in calls
  katsyoshi
  committed
  e5b0c68
- Preserve newlines after operator symbols
  katsyoshi
  committed
  90f3fef
- Fix contextual Ruby lexer tokens
  katsyoshi
  committed
  bc794f0
- Restore alias and symbol lexer boundaries
  katsyoshi
  committed
  af7a709
- Handle keyword-shaped receiver setters
  katsyoshi
  committed
  64307b5
- Classify lambda command blocks correctly
  katsyoshi
  committed
  a9becbd
- Remove synthetic block argument tokens
  katsyoshi
  committed
  b64fd69
- Track block delimiter ownership
  katsyoshi
  committed
  40a0e75
- Scan regexp interpolation boundaries
  katsyoshi
  committed
  730b7b7
- Lex bracket operators in aliases
  katsyoshi
  committed
  6b6b5da
- Ignore newline before block parameters
  katsyoshi
  committed
  be5b9be
- Preserve alias newline lexer state
  katsyoshi
  committed
  6ed16bf
- Lex setter definitions without arguments
  katsyoshi
  committed
  46922d7
- Classify splat method body hashes
  katsyoshi
  committed
  86ac8ff
- Preserve bracket operators in aliases
  katsyoshi
  committed
  6feb8ad
- Restore lambda block context
  katsyoshi
  committed
  09e536e
- Preserve heredoc suffix context
  katsyoshi
  committed
  2002677
- Preserve blocks around singleton classes
  katsyoshi
  committed
  0cc8a57
- Continue method chains through comments
  katsyoshi
  committed
  9765c2b
- Track conditional block endings
  katsyoshi
  committed
  3cb4bec
- Preserve method scopes inside blocks
  katsyoshi
  committed
  7d3ac25
- Classify negative command blocks
  katsyoshi
  committed
  9c3d8b7
- Lex operator symbols without literals
  katsyoshi
  committed
  9bebe2a
- Finish Rails Ruby lexer compatibility
  katsyoshi
  committed
  acf7692
- Cover remaining Rails trick syntax
  katsyoshi
  committed
  5dfe43d

Commits

Commits on Sep 10, 2026

Commits on Sep 12, 2026

Commits on Sep 13, 2026