tokensFromString(input = "") {
    try {
      const tokens = this.encoder.encode(String(input), undefined, []);
      return tokens;
    } catch (e) {
      console.error(e);
      return [];
    }
  }
Pass in an empty array of disallowedSpecials to handle all tokens as text and to be tokenized.
@param {string} input
@returns {number[]}