Skip to content

Commit

Permalink
and removed already
Browse files Browse the repository at this point in the history
  • Loading branch information
Pentarctagon committed Sep 17, 2024
1 parent 43fc30c commit 002f83f
Showing 1 changed file with 0 additions and 4 deletions.
4 changes: 0 additions & 4 deletions src/serialization/tokenizer.hpp
Original file line number Diff line number Diff line change
Expand Up @@ -28,10 +28,6 @@
// has something to do with the result of the preprocessor whose format is essentially undocumented and I don't intend to delve into that as of writing this comment
#define INLINED_PREPROCESS_DIRECTIVE_CHAR 254

// normal ascii is 0-127
// extended ascii is from 128-255, none of which need any special handling
#define START_EXTENDED_ASCII 128

/**
* contains the current text being parsed as well as the token_type of what's being parsed.
* multi-character token types will have a value that's a string with zero or more characters in it.
Expand Down

0 comments on commit 002f83f

Please sign in to comment.