pre_tokenize_text(text, options) {
        throw Error("pre_tokenize_text should be implemented in subclass.")
    }
Method that should be implemented by subclasses to define the specific pre-tokenization logic.

@abstract
@param {string} text The text to pre-tokenize.
@param {Object} [options] Additional options for the pre-tokenization logic.
@returns {string[]} The pre-tokenized text.
@throws {Error} If the method is not implemented in the subclass.