-
Notifications
You must be signed in to change notification settings - Fork 0
refactor tokenizer #19
Copy link
Copy link
Open
Labels
FutureThis issue or PR is something that will be added in the future.This issue or PR is something that will be added in the future.Help WantedExtra attention is neededExtra attention is needed
Metadata
Metadata
Assignees
Labels
FutureThis issue or PR is something that will be added in the future.This issue or PR is something that will be added in the future.Help WantedExtra attention is neededExtra attention is needed
Type
Fields
Give feedbackNo fields configured for issues without a type.
Refactor should include a complete overhaul, better utilizing cursor and AST.
For example, maybe remove repetition in code as seen here:

(can't think of a better alternative at the moment)