Class Tokenizer

    • Field Detail

      • inArray

        protected boolean inArray
      • word

        protected int word
      • pushed

        protected Token pushed
      • last

        protected Token last
    • Constructor Detail

      • Tokenizer

        public Tokenizer​(java.lang.CharSequence text)
    • Method Detail

      • next

        public Token next()
      • push

        public void push​(Token token)
      • readHereDoc

        public Token readHereDoc​(boolean ignoreLeadingTabs)