- Declarations of WORD-CHR cannot contain ANY
Whitespace; tabs (\t) or spaces (" ").
Because the standard tokenizer in the C++ STL library (strtok)
automatically removes whitespace, we cannot compensate or determine how
many whitespace characters are contained within the single quotes. With
this, a null pointer error will be thrown and our compiler will force
quit. Aside from writing out own individual, catered tokenizer; at the
beginning of each parser iteration, we can check for single quotations,
and any whitespace found in between those, replace with a garbage
character such as '$' or '§'. Then, when we actually produce object
code, replace those symbols with the 8 bit ASCII value for the tabs
(\t) or spaces (" ").
--- WORD-CHR issue fixed as of November 16th, 2009. ---
- Source code has a limitation of 900 characters per line.
To pull off a line of source code for parsing, we must set a predetermined length for the char* array. We have it hardcoded in the program for the 900 character limit. In the case a line exceeds 900 characters, no error will occur, and the remaining comment text after the 900th character will simply not be displayed in the source output.