Add new SentenceTransformer model

1_Pooling/config.json

@@ -0,0 +1,10 @@
+{
+    "word_embedding_dimension": 768,
+    "pooling_mode_cls_token": false,
+    "pooling_mode_mean_tokens": true,
+    "pooling_mode_max_tokens": false,
+    "pooling_mode_mean_sqrt_len_tokens": false,
+    "pooling_mode_weightedmean_tokens": false,
+    "pooling_mode_lasttoken": false,
+    "include_prompt": true
+}

README.md

@@ -0,0 +1,666 @@
+---
+tags:
+- sentence-transformers
+- sentence-similarity
+- feature-extraction
+- dense
+- generated_from_trainer
+- dataset_size:3016
+- loss:MultipleNegativesRankingLoss
+base_model: nomic-ai/modernbert-embed-base
+widget:
+- source_sentence: The Keeper/Aquarist is responsible for the care and management
+    of wildlife within the organisation/attractions sites. This includes the preparation
+    and feeding of food to the wildlife, caring for ill animals, checking enclosures
+    and cages for signs of wear or damage for animal, staff and visitor safety, and
+    giving educational talks/tours to the visitors. He/she also maintains animal training
+    behaviours and promotes conservation awareness through his animal presentations.
+    Detail-oriented with a strong passion for animals, he is attentive to the needs
+    of the wildlife under his care, and leverages his strong communication skills
+    to communicate effectively with visitors on the characteristics and behaviours
+    of the wildlife. He is physically fit and works in a shift system encompassing
+    weekends and public holidays. Outside the working hours, he may be on a rota for
+    call-outs. He often stays outdoors for long periods of time even through inclement
+    weather, and may need a driving licence if he is working in a large zoo or safari
+    park. He may also need a scuba-diving licence if working in an aquarium.
+  sentences:
+  - The Director of Nursing in the Education sector collaborates closely with the
+    Chief Nurse to develop a comprehensive nursing education framework that addresses
+    the diverse learning requirements of nursing students and practicing nurses. This
+    role involves identifying emerging competencies and partnering with critical stakeholders
+    to promote adaptable and responsive skill acquisition that enhances the nursing
+    workforce's capabilities. The Director champions nursing practice through exceptional
+    ongoing professional development initiatives tailored to meet the changing demands
+    of the national healthcare landscape. Additionally, they secure organizational
+    resources to support nurses in their lifelong learning journeys and encourage
+    the integration of cutting-edge technologies and innovations in nursing education.
+    This position operates across various environments, including acute care, primary
+    care, and community care, requiring a visionary leader who is dynamic and attuned
+    to the evolving healthcare needs, with strong leadership abilities in fostering
+    psychological resilience and creating effective learning environments.
+  - 'The Keeper/Aquarist is responsible for managing the administrative tasks related
+    to wildlife licensing and permits within the organization. This includes ensuring
+    compliance with local regulations, filing necessary documents, and maintaining
+    records, without direct interaction with the animals or visitors.
+
+
+    The Keeper/Aquarist oversees a team of junior staff members and is focused on
+    strategic planning for conservation policies rather than hands-on animal care.
+    This role requires several years of experience in management and decision-making
+    authority regarding budget allocations and resource management.
+
+
+    The Keeper/Aquarist works as a Compliance Associate in the banking sector, where
+    he/she analyzes regulatory frameworks and ensures adherence to financial policies.
+    This position requires a strong understanding of financial compliance rather than
+    animal welfare.
+
+
+    The Keeper/Aquarist is tasked with wildlife management in an international context,
+    focusing on cross-border regulatory issues and global wildlife trade laws, without
+    direct involvement in animal care or public education.
+
+
+    The Keeper/Aquarist combines duties of an event coordinator and animal caretaker,
+    responsible for planning wildlife-related events while also providing care for
+    the animals, leading to confusion in priorities and skill requirements across
+    both roles.'
+  - The Keeper/Aquarist is entrusted with the comprehensive care and management of
+    wildlife within the organization’s attractions. This role involves preparing and
+    providing nutritious food for the animals, tending to those that are unwell, and
+    inspecting enclosures for any signs of damage to ensure the safety of animals,
+    staff, and visitors. The Keeper/Aquarist also engages guests through educational
+    talks and tours, enhancing their understanding of wildlife conservation. With
+    a keen eye for detail and a deep passion for animals, he/she is dedicated to meeting
+    the needs of the creatures in their care and utilizes strong communication skills
+    to effectively share insights about animal behavior and characteristics with visitors.
+    The position requires physical fitness, as it involves working shifts that include
+    weekends and public holidays. Additionally, the Keeper/Aquarist may be on call
+    outside regular hours and is accustomed to spending extended periods outdoors,
+    regardless of weather conditions. A driving license is essential for those working
+    in larger facilities, and a scuba-diving license may be required for aquarium
+    settings.
+- source_sentence: The Executive Sous Chef is responsible for managing kitchen operations
+    by running the pass and informing cooks of the orders, monitoring speed and rhythm
+    of coursing and overseeing plating of dishes throughout. He/She reviews proposed
+    initiatives for continuous improvement and monitors the adherence to customer
+    services standards. He outlines the organisations service, food hygiene, health
+    and safety standards. Resourceful and detail-oriented, he is able to serve as
+    a mentor who directs subordinates during kitchen operations. He possesses a service
+    mindset and guides his teams to anticipate customer needs. He is expected to work
+    long hours and handle the pressure in a fast-paced kitchen environment.
+  sentences:
+  - The Executive Sous Chef oversees kitchen operations by coordinating order flow
+    and guiding cooks on dish preparation, ensuring timely service and presentation.
+    He/She evaluates new initiatives for ongoing enhancement while ensuring compliance
+    with customer service standards. He establishes the organization’s food safety,
+    hygiene, and health protocols. With a resourceful and meticulous approach, he
+    mentors team members during kitchen activities, fostering a service-oriented atmosphere
+    that anticipates customer preferences. The role demands resilience and the ability
+    to thrive in a high-pressure culinary environment.
+  - 'The Executive Sous Chef is tasked with managing front-of-house operations by
+    coordinating dining room service and overseeing waitstaff during meal service,
+    ensuring a smooth dining experience for guests.
+
+
+    The Executive Sous Chef leads a team of junior chefs, focusing on daily kitchen
+    tasks without significant decision-making authority, and reports to the Head Chef
+    for all operational directives.
+
+
+    The Executive Sous Chef functions as a Marketing Associate in the hospitality
+    industry, utilizing analytical skills to develop promotional materials and campaigns,
+    while ensuring compliance with brand standards.
+
+
+    The Executive Sous Chef is responsible for managing kitchen operations in a remote
+    island resort, adapting to unique local regulations and culinary practices that
+    differ significantly from urban environments.
+
+
+    The Executive Sous Chef combines responsibilities from both the culinary and accounting
+    departments, overseeing kitchen inventory management while also preparing financial
+    reports and budget forecasts inaccurately.'
+  - The Lead Maintenance Engineer oversees reliability-focused maintenance initiatives
+    to guarantee the ongoing airworthiness of the aircraft fleet. He/She provides
+    direction to team members involved in aircraft maintenance operations and spearheads
+    asset performance evaluation. He manages intricate projects and formulates maintenance
+    strategies based on pertinent technical data, original equipment manufacturer
+    (OEM) guidelines, and regulatory standards. As a recognized authority in the field,
+    he is responsible for executing work instructions, ensuring quality control, and
+    enhancing workflow efficiencies to boost the organization's productivity. He actively
+    engages in technical and program assessments, reviews documentation, and ensures
+    adherence to engineering policies and procedures set forth by the organization,
+    clients, and regulatory bodies. He assesses compliance with airworthiness and
+    legislative standards while suggesting improvements to the organization's standard
+    operating procedures (SOPs) and safety, health, and quality systems. He plays
+    a proactive role in advancing lean and sustainable practices and conducts research
+    and innovation in specific areas for ongoing process enhancements. He evaluates
+    staff performance and provides coaching and mentoring to technical team members.
+    He should demonstrate strong decision-making, resource management, and project
+    management capabilities, as well as effective problem-solving, communication,
+    and stakeholder engagement skills to address unexpected challenges in fleet management.
+- source_sentence: The Mechanical Engineer/Electrical Engineer manages the planning
+    and development of projects. He/She develops mechanical and/or electrical engineering
+    designs based on project requirements, from conceptual to schematic and detailed
+    designs. He is responsible for designing mechanical and electrical systems. He
+    conducts project assessments and is able to provide feasible and creative solutions
+    based on the assessment results. He participates in the tendering process and
+    assists with the projects' costs and budgets. He plans the team's manpower and
+    provides on-the-job coaching to junior staff. He is meticulous, highly detail-oriented
+    and has a keen interest to incorporate new technologies into engineering design
+    projects. He possesses excellent knowledge in mechanical and/or electrical engineering
+    fields, is analytical and has good problem-solving skills. He also possesses strong
+    interpersonal and project coordination skills crucial for engagement with internal
+    and external stakeholders. He is required to work both in office and at project
+    sites.
+  sentences:
+  - 'The Mechanical Designer oversees the aesthetic aspects of product design, focusing
+    on visual appeal rather than engineering functionality.
+
+
+    The Senior Electrical Engineer is responsible for high-level decision-making and
+    strategic planning without direct involvement in project execution or team management.
+
+
+    The Compliance Engineer in the pharmaceutical industry ensures that products meet
+    regulatory standards, utilizing similar analytical skills but in a completely
+    different context.
+
+
+    The Electrical Engineer in the European market adapts designs to comply with specific
+    EU regulations, requiring knowledge of different compliance standards and practices.
+
+
+    The Mechanical Engineer/Software Developer hybrid role combines hardware design
+    with software coding, leading to confusion between engineering responsibilities
+    and programming tasks.'
+  - The Barista Supervisor oversees the crafting of beverages in accordance with the
+    organization's established recipes and protocols. This role involves preparing
+    and suggesting unique, customized drinks to enhance customer satisfaction. To
+    ensure exceptional customer service, he/she regularly evaluates compliance with
+    service standards. The supervisor also assists in daily operations by organizing
+    staff schedules and initiating continuous improvement activities. Additionally,
+    he/she ensures adherence to service, food safety, and health regulations. With
+    a friendly demeanor and a service-oriented mindset, the supervisor effectively
+    manages various tasks while maintaining composure and confidence in interactions
+    with a diverse clientele. Flexibility in scheduling is essential, including availability
+    for weekends, late nights, and public holidays, along with the endurance to remain
+    on their feet for extended periods.
+  - The Mechanical Engineer/Electrical Engineer oversees the strategic planning and
+    execution of engineering projects. He/She creates innovative mechanical and/or
+    electrical designs tailored to project specifications, progressing from initial
+    concepts to fully detailed designs. His/her role includes the design of mechanical
+    and electrical systems, conducting thorough project evaluations, and delivering
+    practical and inventive solutions based on these evaluations. He/She plays an
+    active role in the bidding process and supports budget management for projects.
+    Additionally, he/she organizes team resources and provides mentorship to junior
+    engineers. With a meticulous approach and a passion for integrating cutting-edge
+    technologies into engineering designs, he/she demonstrates exceptional expertise
+    in mechanical and/or electrical engineering disciplines, strong analytical skills,
+    and proficient problem-solving abilities. He/She also possesses excellent interpersonal
+    and project management skills essential for effective collaboration with both
+    internal teams and external partners. The role requires working in both office
+    settings and on-site at project locations.
+- source_sentence: The Assistant Coordination and Reservations Executive assists in
+    processing reservations of travel, including air tickets, hotels and attractions
+    and issues reservation slips for group reservations. He/She also processes refund
+    requests in cases of partially-utilised tickets and knows the airline terminology,
+    codes, fare basis, aviation rules and tariffs. Service-oriented with strong multi-tasking
+    skills, he liaises with suppliers and customer support department to coordinate
+    any changes to reservations. He is also able to perform in a fast paced environment
+    and perform checks on the availability of products and services with vendors and
+    holds reservations. He assists in the coordination of travel operations including
+    arranging of tickets to attractions, coaches, meals and hotel rooms allocation.
+    He may be required to work on weekends, evenings, and public holidays in an office
+    environment.
+  sentences:
+  - "The Assistant Coordination and Reservations Executive oversees the management\
+    \ of corporate travel budgets, including the negotiation of contracts with travel\
+    \ vendors. \n\nThe Assistant Coordination and Reservations Executive leads a team\
+    \ of travel consultants, focusing on strategic planning and long-term travel program\
+    \ development.\n\nThe Assistant Coordination and Reservations Executive is responsible\
+    \ for compliance audits in the healthcare industry, ensuring adherence to regulatory\
+    \ standards and internal policies.\n\nThe Assistant Coordination and Reservations\
+    \ Executive manages international travel logistics for corporate clients, navigating\
+    \ complex global regulations and cross-border travel requirements.\n\nThe Assistant\
+    \ Coordination and Reservations Executive combines event planning and travel coordination,\
+    \ tasked with organizing large-scale conferences while also handling personal\
+    \ travel arrangements."
+  - The Automation Technician is responsible for the operation and maintenance of
+    automation equipment and systems utilized in stage productions, working under
+    the guidance of senior team members. This role involves setting parameters for
+    automated stage elements and collaborating with various stakeholders to optimize
+    programming and make necessary adjustments for precise movements and placements
+    that align with design intentions. During live performances, the technician will
+    manage automation systems in accordance with stage cues to ensure operational
+    safety and fluidity. Additionally, the Automation Technician plays a key role
+    in tracking maintenance, troubleshooting issues, and repairing equipment as needed.
+    This position can be offered on a full-time or casual basis in venues, rental
+    firms, production companies, or directly for productions.
+  - The Assistant Coordination and Reservations Executive plays a crucial role in
+    managing travel bookings, encompassing airfares, accommodations, and attractions.
+    This position involves generating reservation confirmations for group travel and
+    processing refund applications for partially used tickets. The ideal candidate
+    is knowledgeable about airline jargon, fare structures, aviation regulations,
+    and pricing. With a focus on customer service and exceptional multitasking capabilities,
+    the executive collaborates with suppliers and the customer support team to adjust
+    reservations as needed. Capable of thriving in a dynamic environment, he/she checks
+    product and service availability with vendors and manages bookings efficiently.
+    The role includes organizing travel logistics such as tickets for attractions,
+    transportation, dining, and hotel assignments, with the expectation of availability
+    to work weekends, evenings, and public holidays in an office setting.
+- source_sentence: The Principal Security Consultant is responsible for leading a
+    team to clinch consultancy projects to provide security audits, reviews and security
+    risk assessment services to clients and recommend improvements to existing security
+    measures. He/She is required to evaluate tender documents and manage the deployment
+    of security consultants to develop security protection and implementation plans
+    for various types of facilities. He is required to work in an office environment
+    and perform site visits when necessary. He is expected to communicate with relevant
+    stakeholders and clients as part of his role in performing the respective duties.
+    This requires him to be analytical, responsive, decisive and cooperative.
+  sentences:
+  - The Senior Principal Occupational Therapy Educator is responsible for guiding
+    and evaluating various training initiatives and programs within the department.
+    This role involves providing specialized training to occupational therapists and
+    spearheading professional development efforts. The educator develops and executes
+    frameworks that enhance learning opportunities throughout the department. The
+    position may be situated in diverse environments, including public and private
+    sectors, acute care hospitals, rehabilitation facilities, voluntary welfare organizations,
+    educational institutions, and client homes. Collaboration with interdisciplinary
+    teams, which may comprise educators, healthcare professionals, and therapists,
+    is also a key aspect of the role. The ideal candidate should demonstrate visionary
+    leadership, innovation, and a strong commitment to the advancement of therapists'
+    skills. Effective interpersonal, communication, and team-building abilities are
+    essential for success in this position.
+  - The Principal Security Consultant is tasked with spearheading a team to secure
+    consultancy projects focused on delivering security audits, assessments, and risk
+    evaluations to clients, while also suggesting enhancements to current security
+    protocols. This role involves reviewing tender documents and overseeing the assignment
+    of security specialists to formulate protection strategies and implementation
+    plans for diverse facilities. The position primarily operates in an office setting,
+    with occasional site visits required. Effective communication with stakeholders
+    and clients is essential for fulfilling the responsibilities of this role, demanding
+    strong analytical, responsive, decisive, and collaborative skills.
+  - "The Principal Security Consultant is responsible for managing a team to oversee\
+    \ marketing campaigns, analyzing market trends, and developing promotional strategies\
+    \ for various products. \n\nThe Principal Security Consultant oversees the operations\
+    \ of a junior audit team, focusing on compliance with internal policies and ensuring\
+    \ adherence to basic regulatory requirements.\n\nThe Principal Security Consultant\
+    \ is engaged in financial analysis, requiring expertise in budget forecasting\
+    \ and revenue management within the retail sector.\n\nThe Principal Security Consultant\
+    \ is tasked with leading cross-border legal compliance initiatives, requiring\
+    \ knowledge of international law and regulations specific to the European market.\n\
+    \nThe Principal Security Consultant combines project management and IT support\
+    \ roles, focusing on both strategic planning and technical troubleshooting for\
+    \ software applications."
+datasets:
+- frankwong2001/ssf-train-valid-full-synthetic-v3
+pipeline_tag: sentence-similarity
+library_name: sentence-transformers
+---
+
+# SentenceTransformer based on nomic-ai/modernbert-embed-base
+
+This is a [sentence-transformers](https://www.SBERT.net) model finetuned from [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) on the [ssf-train-valid-full-synthetic-v3](https://huggingface.co/datasets/frankwong2001/ssf-train-valid-full-synthetic-v3) dataset. It maps sentences & paragraphs to a 768-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.
+
+## Model Details
+
+### Model Description
+- **Model Type:** Sentence Transformer
+- **Base model:** [nomic-ai/modernbert-embed-base](https://huggingface.co/nomic-ai/modernbert-embed-base) <!-- at revision d556a88e332558790b210f7bdbe87da2fa94a8d8 -->
+- **Maximum Sequence Length:** 8192 tokens
+- **Output Dimensionality:** 768 dimensions
+- **Similarity Function:** Cosine Similarity
+- **Training Dataset:**
+    - [ssf-train-valid-full-synthetic-v3](https://huggingface.co/datasets/frankwong2001/ssf-train-valid-full-synthetic-v3)
+<!-- - **Language:** Unknown -->
+<!-- - **License:** Unknown -->
+
+### Model Sources
+
+- **Documentation:** [Sentence Transformers Documentation](https://sbert.net)
+- **Repository:** [Sentence Transformers on GitHub](https://github.com/UKPLab/sentence-transformers)
+- **Hugging Face:** [Sentence Transformers on Hugging Face](https://huggingface.co/models?library=sentence-transformers)
+
+### Full Model Architecture
+
+```
+SentenceTransformer(
+  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False, 'architecture': 'ModernBertModel'})
+  (1): Pooling({'word_embedding_dimension': 768, 'pooling_mode_cls_token': False, 'pooling_mode_mean_tokens': True, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
+  (2): Normalize()
+)
+```
+
+## Usage
+
+### Direct Usage (Sentence Transformers)
+
+First install the Sentence Transformers library:
+
+```bash
+pip install -U sentence-transformers
+```
+
+Then you can load this model and run inference.
+```python
+from sentence_transformers import SentenceTransformer
+
+# Download from the 🤗 Hub
+model = SentenceTransformer("frankwong2001/3_modernbert-embed-base")
+# Run inference
+sentences = [
+    'The Principal Security Consultant is responsible for leading a team to clinch consultancy projects to provide security audits, reviews and security risk assessment services to clients and recommend improvements to existing security measures. He/She is required to evaluate tender documents and manage the deployment of security consultants to develop security protection and implementation plans for various types of facilities. He is required to work in an office environment and perform site visits when necessary. He is expected to communicate with relevant stakeholders and clients as part of his role in performing the respective duties. This requires him to be analytical, responsive, decisive and cooperative.',
+    'The Principal Security Consultant is tasked with spearheading a team to secure consultancy projects focused on delivering security audits, assessments, and risk evaluations to clients, while also suggesting enhancements to current security protocols. This role involves reviewing tender documents and overseeing the assignment of security specialists to formulate protection strategies and implementation plans for diverse facilities. The position primarily operates in an office setting, with occasional site visits required. Effective communication with stakeholders and clients is essential for fulfilling the responsibilities of this role, demanding strong analytical, responsive, decisive, and collaborative skills.',
+    'The Principal Security Consultant is responsible for managing a team to oversee marketing campaigns, analyzing market trends, and developing promotional strategies for various products. \n\nThe Principal Security Consultant oversees the operations of a junior audit team, focusing on compliance with internal policies and ensuring adherence to basic regulatory requirements.\n\nThe Principal Security Consultant is engaged in financial analysis, requiring expertise in budget forecasting and revenue management within the retail sector.\n\nThe Principal Security Consultant is tasked with leading cross-border legal compliance initiatives, requiring knowledge of international law and regulations specific to the European market.\n\nThe Principal Security Consultant combines project management and IT support roles, focusing on both strategic planning and technical troubleshooting for software applications.',
+]
+embeddings = model.encode(sentences)
+print(embeddings.shape)
+# [3, 768]
+
+# Get the similarity scores for the embeddings
+similarities = model.similarity(embeddings, embeddings)
+print(similarities)
+# tensor([[1.0000, 0.9259, 0.2866],
+#         [0.9259, 1.0000, 0.3057],
+#         [0.2866, 0.3057, 1.0000]])
+```
+
+<!--
+### Direct Usage (Transformers)
+
+<details><summary>Click to see the direct usage in Transformers</summary>
+
+</details>
+-->
+
+<!--
+### Downstream Usage (Sentence Transformers)
+
+You can finetune this model on your own dataset.
+
+<details><summary>Click to expand</summary>
+
+</details>
+-->
+
+<!--
+### Out-of-Scope Use
+
+*List how the model may foreseeably be misused and address what users ought not to do with the model.*
+-->
+
+<!--
+## Bias, Risks and Limitations
+
+*What are the known or foreseeable issues stemming from this model? You could also flag here known failure cases or weaknesses of the model.*
+-->
+
+<!--
+### Recommendations
+
+*What are recommendations with respect to the foreseeable issues? For example, filtering explicit content.*
+-->
+
+## Training Details
+
+### Training Dataset
+
+#### ssf-train-valid-full-synthetic-v3
+
+* Dataset: [ssf-train-valid-full-synthetic-v3](https://huggingface.co/datasets/frankwong2001/ssf-train-valid-full-synthetic-v3) at [b816c6b](https://huggingface.co/datasets/frankwong2001/ssf-train-valid-full-synthetic-v3/tree/b816c6b9a13eb26993c3f9be6bf585ff5b3097c4)
+* Size: 3,016 training samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 1000 samples:
+  |         | anchor                                                                               | positive                                                                             | negative                                                                             |
+  |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                               | string                                                                               |
+  | details | <ul><li>min: 66 tokens</li><li>mean: 169.89 tokens</li><li>max: 355 tokens</li></ul> | <ul><li>min: 67 tokens</li><li>mean: 160.73 tokens</li><li>max: 323 tokens</li></ul> | <ul><li>min: 80 tokens</li><li>mean: 296.5 tokens</li><li>max: 1718 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                       |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Branch Manager is responsible for ensuring the achievement of the branch's financial targets. He/She is responsible for all functions of the branch under his care, such as hiring employees, implementing service initiatives, overseeing the approval of loans and lines of credit, marketing, and assisting with customer relations. He effectively manages team members within his branch, including developing and motivating them to perform and achieve sales targets. The Branch Manager may occasionally be required to work weekends and after hours. He has good organisational skills, is diligent and possesses strong people management capabilities. He is customer focused, has keen problem solving abilities and is able to manage internal and external stakeholders from a variety of backgrounds.</code>                                                                                                                                                                                                                  | <code>The Branch Manager oversees the successful attainment of the branch's financial objectives. This role encompasses all operational aspects of the branch, including recruiting staff, executing service strategies, managing loan and credit approvals, conducting marketing efforts, and facilitating customer engagement. The Branch Manager adeptly leads team members, fostering their development and driving them towards achieving sales goals. Occasionally, this position may require working on weekends and after hours. The ideal candidate demonstrates excellent organizational skills, a strong work ethic, and possesses exceptional people management abilities. A customer-centric approach, along with proficient problem-solving skills and the ability to engage with diverse internal and external stakeholders, is essential.</code>                                                                                                                                                                                         | <code>The Branch Manager is tasked with ensuring compliance with environmental regulations across various departments. He/She is responsible for all aspects of environmental audits, including recruiting compliance officers, implementing sustainability initiatives, overseeing the approval of waste disposal methods, marketing green practices, and managing community relations. He effectively collaborates with team members to enhance compliance metrics and achieve sustainability targets. The Branch Manager may be required to work in extreme weather conditions. He has strong analytical skills, is detail-oriented, and possesses excellent project management capabilities. He is focused on environmental impact, has sharp analytical abilities, and can manage regulatory stakeholders from different sectors.<br><br>The Branch Manager is accountable for the strategic growth of multiple branches within an international organization. This senior role involves high-level decision-making, including mergers and acqu...</code> |
+  | <code>The Head of IT Audit develops the organisation's IT audit framework to manage regulatory and operational risks to safeguard IT assets. He/She defines key objectives and guiding principles for the formulation of IT risk management programs, as well as procedures for documenting and updating policies, standards, guidelines relating to the management of IT assets. He advices on the development of IT audit plans and ensures that audit plans comply with regulatory, operational, security risks and relevant internal auditing standards. He oversees the conduct of audits, respective investigations into non-compliance and risks identified from audits. He overlooks new IT policies, systems and processes necessary for enhancing IT controls and mitigate risks. He consults with and advises senior leaders regarding internal controls and security procedures, prepares activity and progress reports relating to the IT audit function. He also guide team members on procedures, technical problems, prioritie...</code> | <code>The Head of IT Audit is responsible for establishing a comprehensive IT audit framework that effectively manages regulatory and operational risks to protect the organization’s IT assets. This role involves defining essential objectives and principles for developing IT risk management strategies, as well as creating procedures for the documentation and updating of policies, standards, and guidelines related to IT asset management. The individual provides strategic advice on IT audit planning and ensures compliance with relevant regulations, operational standards, and security risks in line with internal auditing practices. Additionally, the Head of IT Audit supervises audit execution, investigates instances of non-compliance, and addresses risks identified during audits. The role includes overseeing the implementation of new IT policies, systems, and processes to strengthen IT controls and mitigate risks. The Head of IT Audit collaborates with senior leadership to enhance internal contr...</code> | <code>The Head of IT Audit is tasked with managing financial audits across various departments to ensure compliance with budgetary constraints and fiscal regulations. <br><br>The Head of IT Audit functions as a Junior Audit Associate, responsible for assisting in the execution of basic audit tasks under close supervision, with limited decision-making authority.<br><br>The Head of IT Audit serves as a Compliance Officer in the healthcare sector, focusing on regulatory compliance and quality assurance in clinical practices rather than IT environments.<br><br>The Head of IT Audit oversees cross-border financial reporting for international subsidiaries, navigating different accounting standards and regulations while ensuring compliance with local market practices.<br><br>The Head of IT Audit combines responsibilities of a Project Manager and a Risk Analyst, overseeing multiple unrelated projects while simultaneously assessing risks across diverse business units without a clear focus on IT auditing.</code>       |
+  | <code>A Nurse Manager is responsible for planning, coordinating, directing, and evaluating operational activities and resource utilisation in the department. S/He is also responsible for managing nursing manpower operating expenses and budget effectively to provide high quality patient care. S/He oversees at least one unit. S/He oversees the professional and personal development of all staff under her/his charge. Her/His core function is in managerial tasks, but s/he will also perform some clinical, educational and research tasks in the course of her/his day-to-day work. S/He provides guidance to assistant nurse clinicians and below to ensure optimal care is provided to meet desired patient outcomes and experience. S/He operates in a wide variety of settings such as acute care, primary care, community hospitals, integrated care and long-term care facilities. S/He should be resourceful, prudent, tactful and persuasive.</code>                                                                               | <code>The Nurse Manager is tasked with organizing, supervising, and assessing the operational functions and resource allocation within the department. They are accountable for effectively managing nursing workforce budgets and expenses to ensure the delivery of exemplary patient care. The Nurse Manager oversees at least one nursing unit and is responsible for fostering both the professional and personal growth of all team members under their leadership. While primarily focused on managerial duties, they also engage in clinical, educational, and research activities as part of their daily responsibilities. Additionally, they provide support and direction to assistant nurse clinicians and lower-level staff to guarantee that optimal care is provided, aligning with desired patient outcomes and experiences. The role is carried out in diverse environments, including acute care, primary care, community hospitals, integrated care, and long-term care facilities. Ideal candidates will be resourceful, p...</code> | <code>The Nurse Manager is focused on developing marketing strategies, coordinating promotional activities, and evaluating the effectiveness of advertising campaigns in the department. They are responsible for managing the budget for marketing materials and operational expenses to enhance brand visibility. The Nurse Manager oversees at least one team of marketing specialists and is tasked with driving the professional growth of all personnel involved. While their primary role is in marketing tasks, they will also conduct some sales training and customer research during their daily activities. They provide mentorship to junior marketing associates and below to ensure effective communication is maintained with clients. The position is performed in various sectors, such as retail, hospitality, and entertainment. Candidates should be innovative, analytical, strategic, and persuasive.<br><br>The Nurse Manager is responsible for supervising nursing operations at a senior level, managing large-scale budg...</code> |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Evaluation Dataset
+
+#### ssf-train-valid-full-synthetic-v3
+
+* Dataset: [ssf-train-valid-full-synthetic-v3](https://huggingface.co/datasets/frankwong2001/ssf-train-valid-full-synthetic-v3) at [b816c6b](https://huggingface.co/datasets/frankwong2001/ssf-train-valid-full-synthetic-v3/tree/b816c6b9a13eb26993c3f9be6bf585ff5b3097c4)
+* Size: 754 evaluation samples
+* Columns: <code>anchor</code>, <code>positive</code>, and <code>negative</code>
+* Approximate statistics based on the first 754 samples:
+  |         | anchor                                                                               | positive                                                                             | negative                                                                              |
+  |:--------|:-------------------------------------------------------------------------------------|:-------------------------------------------------------------------------------------|:--------------------------------------------------------------------------------------|
+  | type    | string                                                                               | string                                                                               | string                                                                                |
+  | details | <ul><li>min: 58 tokens</li><li>mean: 169.85 tokens</li><li>max: 380 tokens</li></ul> | <ul><li>min: 54 tokens</li><li>mean: 160.26 tokens</li><li>max: 362 tokens</li></ul> | <ul><li>min: 94 tokens</li><li>mean: 304.69 tokens</li><li>max: 1330 tokens</li></ul> |
+* Samples:
+  | anchor                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                   | positive                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                 | negative                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                                         |
+  |:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|:---------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------|
+  | <code>The Venue Operations Manager is responsible for overseeing the running of venue operations, including the logistics requirements. He/She works closely with event services department to ensure client requirements are fulfilled in compliance to local health and safety standards. He reviews event plans to ensure generation of maximum yield for organisation. Meticulous and resourceful, he possesses excellent problem-solving skills and is able to react quickly to deviations in the project plans. He is able to work in a flexible workweek, including weekends, evenings, and public holidays, and is comfortable working in both an indoor and outdoor environment depending on the nature and requirements of the events.</code>                                                                                                                                                                                                                                                                                                  | <code>The Venue Operations Manager is tasked with managing the day-to-day functions of venue operations, including logistical planning and execution. Collaborating closely with the event services team, he/she ensures that client needs are met while adhering to local health and safety regulations. The manager evaluates event proposals to maximize organizational profitability. Detail-oriented and innovative, he/she demonstrates strong problem-solving abilities and can swiftly adjust to changes in project timelines. Flexibility in working hours is essential, as the role may require availability during weekends, evenings, and public holidays, and the manager must be adept at working in various environments, whether indoor or outdoor, based on event specifications.</code>                                                                                                                                                                                                                                                | <code>The Venue Operations Coordinator is involved in managing the administrative tasks of venue bookings, focusing on client communications rather than logistics. <br><br>The Venue Operations Director oversees large-scale venue strategies and has decision-making authority over multiple departments, requiring extensive experience in leadership roles.<br><br>The Venue Operations Specialist is responsible for compliance checks in a manufacturing facility, utilizing similar analytical skills but within a different regulatory framework.<br><br>The Venue Operations Manager in a different country is tasked with adhering to international safety standards while managing events that cater to a diverse clientele across borders.<br><br>The Venue Operations Manager combines responsibilities of a catering manager and a maintenance supervisor, overseeing food services while also handling facility repairs, which creates confusion in role expectations.</code>                                                                                    |
+  | <code>The Network Development Principal Engineer provides technical leadership to the network development team and develops detailed project plans for electricity transmission and/or distribution network development and/or the integration of distributed generation sources and energy storage systems with the grid. As the technical expert, he/she reviews project progress reports and investigation findings of site problems encountered to propose follow- up actions. He reviews installation plans for metering equipment and sensors, and leads process improvement initiatives. He leads technical capability development programmes, including on-the-job training and coaching, and formulates the technical training and development plans for the teams. He manages the Permits-to-Work for the team, and establishes Safe System of Work (SSoW) frameworks and practices for his area of work. He proposes emergency technical and recovery activities based on the crisis management framework, and determines the respo...</code> | <code>The Network Development Principal Engineer offers expert technical guidance to the network development team, crafting comprehensive project plans for the enhancement of electricity transmission and distribution networks, as well as the incorporation of distributed energy resources and storage systems into the grid. Acting as the technical authority, he/she evaluates project progress reports and conducts investigations into site issues, recommending appropriate follow-up actions. He/she assesses installation strategies for metering devices and sensors, spearheads initiatives for process enhancements, and directs technical capability-building programs, including hands-on training and mentorship, while devising technical training and development strategies for the team. Additionally, he/she oversees the management of Permits-to-Work for the team, implementing Safe System of Work (SSoW) frameworks and practices specific to the area of responsibility. He/she formulates emergency technical a...</code> | <code>The Network Development Principal Engineer manages the financial operations of the network development team, focusing on budgeting and expense tracking for electricity transmission projects. <br><br>The Network Development Principal Engineer serves as a Junior Engineer who assists with basic tasks under close supervision, requiring minimal experience in network development and no decision-making authority.<br><br>The Network Development Principal Engineer operates as a Compliance Associate in the healthcare sector, ensuring that all regulatory requirements are met while analyzing data for compliance with health regulations.<br><br>The Network Development Principal Engineer focuses on network development projects in a different regulatory environment, specifically in the European market, adapting to varied local standards and practices.<br><br>The Network Development Principal Engineer combines the roles of a project manager and a sales representative, overseeing project timelines while also directly selling n...</code> |
+  | <code>The Keeper/Aquarist is responsible for the care and management of wildlife within the organisation/attractions sites. This includes the preparation and feeding of food to the wildlife, caring for ill animals, checking enclosures and cages for signs of wear or damage for animal, staff and visitor safety, and giving educational talks/tours to the visitors. He/she also maintains animal training behaviours and promotes conservation awareness through his animal presentations. Detail-oriented with a strong passion for animals, he is attentive to the needs of the wildlife under his care, and leverages his strong communication skills to communicate effectively with visitors on the characteristics and behaviours of the wildlife. He is physically fit and works in a shift system encompassing weekends and public holidays. Outside the working hours, he may be on a rota for call-outs. He often stays outdoors for long periods of time even through inclement weather, and may need a driving licence if h...</code> | <code>The Keeper/Aquarist is entrusted with the comprehensive care and management of wildlife within the organization’s attractions. This role involves preparing and providing nutritious food for the animals, tending to those that are unwell, and inspecting enclosures for any signs of damage to ensure the safety of animals, staff, and visitors. The Keeper/Aquarist also engages guests through educational talks and tours, enhancing their understanding of wildlife conservation. With a keen eye for detail and a deep passion for animals, he/she is dedicated to meeting the needs of the creatures in their care and utilizes strong communication skills to effectively share insights about animal behavior and characteristics with visitors. The position requires physical fitness, as it involves working shifts that include weekends and public holidays. Additionally, the Keeper/Aquarist may be on call outside regular hours and is accustomed to spending extended periods outdoors, regardless of weather cond...</code> | <code>The Keeper/Aquarist is responsible for managing the administrative tasks related to wildlife licensing and permits within the organization. This includes ensuring compliance with local regulations, filing necessary documents, and maintaining records, without direct interaction with the animals or visitors.<br><br>The Keeper/Aquarist oversees a team of junior staff members and is focused on strategic planning for conservation policies rather than hands-on animal care. This role requires several years of experience in management and decision-making authority regarding budget allocations and resource management.<br><br>The Keeper/Aquarist works as a Compliance Associate in the banking sector, where he/she analyzes regulatory frameworks and ensures adherence to financial policies. This position requires a strong understanding of financial compliance rather than animal welfare.<br><br>The Keeper/Aquarist is tasked with wildlife management in an international context, focusing on cross-border regulatory issue...</code>       |
+* Loss: [<code>MultipleNegativesRankingLoss</code>](https://sbert.net/docs/package_reference/sentence_transformer/losses.html#multiplenegativesrankingloss) with these parameters:
+  ```json
+  {
+      "scale": 20.0,
+      "similarity_fct": "cos_sim",
+      "gather_across_devices": false
+  }
+  ```
+
+### Training Hyperparameters
+#### Non-Default Hyperparameters
+
+- `eval_strategy`: epoch
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `gradient_accumulation_steps`: 16
+- `learning_rate`: 2e-05
+- `num_train_epochs`: 5
+- `lr_scheduler_type`: cosine
+- `warmup_ratio`: 0.1
+- `bf16`: True
+- `tf32`: False
+- `load_best_model_at_end`: True
+- `batch_sampler`: no_duplicates
+
+#### All Hyperparameters
+<details><summary>Click to expand</summary>
+
+- `overwrite_output_dir`: False
+- `do_predict`: False
+- `eval_strategy`: epoch
+- `prediction_loss_only`: True
+- `per_device_train_batch_size`: 32
+- `per_device_eval_batch_size`: 16
+- `per_gpu_train_batch_size`: None
+- `per_gpu_eval_batch_size`: None
+- `gradient_accumulation_steps`: 16
+- `eval_accumulation_steps`: None
+- `torch_empty_cache_steps`: None
+- `learning_rate`: 2e-05
+- `weight_decay`: 0.0
+- `adam_beta1`: 0.9
+- `adam_beta2`: 0.999
+- `adam_epsilon`: 1e-08
+- `max_grad_norm`: 1.0
+- `num_train_epochs`: 5
+- `max_steps`: -1
+- `lr_scheduler_type`: cosine
+- `lr_scheduler_kwargs`: {}
+- `warmup_ratio`: 0.1
+- `warmup_steps`: 0
+- `log_level`: passive
+- `log_level_replica`: warning
+- `log_on_each_node`: True
+- `logging_nan_inf_filter`: True
+- `save_safetensors`: True
+- `save_on_each_node`: False
+- `save_only_model`: False
+- `restore_callback_states_from_checkpoint`: False
+- `no_cuda`: False
+- `use_cpu`: False
+- `use_mps_device`: False
+- `seed`: 42
+- `data_seed`: None
+- `jit_mode_eval`: False
+- `use_ipex`: False
+- `bf16`: True
+- `fp16`: False
+- `fp16_opt_level`: O1
+- `half_precision_backend`: auto
+- `bf16_full_eval`: False
+- `fp16_full_eval`: False
+- `tf32`: False
+- `local_rank`: 0
+- `ddp_backend`: None
+- `tpu_num_cores`: None
+- `tpu_metrics_debug`: False
+- `debug`: []
+- `dataloader_drop_last`: False
+- `dataloader_num_workers`: 0
+- `dataloader_prefetch_factor`: None
+- `past_index`: -1
+- `disable_tqdm`: False
+- `remove_unused_columns`: True
+- `label_names`: None
+- `load_best_model_at_end`: True
+- `ignore_data_skip`: False
+- `fsdp`: []
+- `fsdp_min_num_params`: 0
+- `fsdp_config`: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
+- `fsdp_transformer_layer_cls_to_wrap`: None
+- `accelerator_config`: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
+- `deepspeed`: None
+- `label_smoothing_factor`: 0.0
+- `optim`: adamw_torch_fused
+- `optim_args`: None
+- `adafactor`: False
+- `group_by_length`: False
+- `length_column_name`: length
+- `ddp_find_unused_parameters`: None
+- `ddp_bucket_cap_mb`: None
+- `ddp_broadcast_buffers`: False
+- `dataloader_pin_memory`: True
+- `dataloader_persistent_workers`: False
+- `skip_memory_metrics`: True
+- `use_legacy_prediction_loop`: False
+- `push_to_hub`: False
+- `resume_from_checkpoint`: None
+- `hub_model_id`: None
+- `hub_strategy`: every_save
+- `hub_private_repo`: None
+- `hub_always_push`: False
+- `hub_revision`: None
+- `gradient_checkpointing`: False
+- `gradient_checkpointing_kwargs`: None
+- `include_inputs_for_metrics`: False
+- `include_for_metrics`: []
+- `eval_do_concat_batches`: True
+- `fp16_backend`: auto
+- `push_to_hub_model_id`: None
+- `push_to_hub_organization`: None
+- `mp_parameters`: 
+- `auto_find_batch_size`: False
+- `full_determinism`: False
+- `torchdynamo`: None
+- `ray_scope`: last
+- `ddp_timeout`: 1800
+- `torch_compile`: False
+- `torch_compile_backend`: None
+- `torch_compile_mode`: None
+- `include_tokens_per_second`: False
+- `include_num_input_tokens_seen`: False
+- `neftune_noise_alpha`: None
+- `optim_target_modules`: None
+- `batch_eval_metrics`: False
+- `eval_on_start`: False
+- `use_liger_kernel`: False
+- `liger_kernel_config`: None
+- `eval_use_gather_object`: False
+- `average_tokens_across_devices`: False
+- `prompts`: None
+- `batch_sampler`: no_duplicates
+- `multi_dataset_batch_sampler`: proportional
+- `router_mapping`: {}
+- `learning_rate_mapping`: {}
+
+</details>
+
+### Training Logs
+| Epoch   | Step   | Training Loss | Validation Loss |
+|:-------:|:------:|:-------------:|:---------------:|
+| 1.0     | 6      | 0.2184        | 0.0124          |
+| 2.0     | 12     | 0.0066        | 0.0010          |
+| 3.0     | 18     | 0.0031        | 0.0006          |
+| 4.0     | 24     | 0.0027        | 0.0006          |
+| **5.0** | **30** | **0.002**     | **0.0005**      |
+
+* The bold row denotes the saved checkpoint.
+
+### Framework Versions
+- Python: 3.12.11
+- Sentence Transformers: 5.1.0
+- Transformers: 4.55.0
+- PyTorch: 2.8.0+cu128
+- Accelerate: 1.10.0
+- Datasets: 4.0.0
+- Tokenizers: 0.21.4
+
+## Citation
+
+### BibTeX
+
+#### Sentence Transformers
+```bibtex
+@inproceedings{reimers-2019-sentence-bert,
+    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
+    author = "Reimers, Nils and Gurevych, Iryna",
+    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
+    month = "11",
+    year = "2019",
+    publisher = "Association for Computational Linguistics",
+    url = "https://arxiv.org/abs/1908.10084",
+}
+```
+
+#### MultipleNegativesRankingLoss
+```bibtex
+@misc{henderson2017efficient,
+    title={Efficient Natural Language Response Suggestion for Smart Reply},
+    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
+    year={2017},
+    eprint={1705.00652},
+    archivePrefix={arXiv},
+    primaryClass={cs.CL}
+}
+```
+
+<!--
+## Glossary
+
+*Clearly define terms in order to be accessible across audiences.*
+-->
+
+<!--
+## Model Card Authors
+
+*Lists the people who create the model card, providing recognition and accountability for the detailed work that goes into its construction.*
+-->
+
+<!--
+## Model Card Contact
+
+*Provides a way for people who have updates to the Model Card, suggestions, or questions, to contact the Model Card authors.*
+-->

config.json

@@ -0,0 +1,45 @@
+{
+  "architectures": [
+    "ModernBertModel"
+  ],
+  "attention_bias": false,
+  "attention_dropout": 0.0,
+  "bos_token_id": 50281,
+  "classifier_activation": "gelu",
+  "classifier_bias": false,
+  "classifier_dropout": 0.0,
+  "classifier_pooling": "mean",
+  "cls_token_id": 50281,
+  "decoder_bias": true,
+  "deterministic_flash_attn": false,
+  "embedding_dropout": 0.0,
+  "eos_token_id": 50282,
+  "global_attn_every_n_layers": 3,
+  "global_rope_theta": 160000.0,
+  "gradient_checkpointing": false,
+  "hidden_activation": "gelu",
+  "hidden_size": 768,
+  "initializer_cutoff_factor": 2.0,
+  "initializer_range": 0.02,
+  "intermediate_size": 1152,
+  "layer_norm_eps": 1e-05,
+  "local_attention": 128,
+  "local_rope_theta": 10000.0,
+  "max_position_embeddings": 8192,
+  "mlp_bias": false,
+  "mlp_dropout": 0.0,
+  "model_type": "modernbert",
+  "norm_bias": false,
+  "norm_eps": 1e-05,
+  "num_attention_heads": 12,
+  "num_hidden_layers": 22,
+  "pad_token_id": 50283,
+  "position_embedding_type": "absolute",
+  "repad_logits_with_grad": false,
+  "sep_token_id": 50282,
+  "sparse_pred_ignore_index": -100,
+  "sparse_prediction": false,
+  "torch_dtype": "float32",
+  "transformers_version": "4.55.0",
+  "vocab_size": 50368
+}

config_sentence_transformers.json

@@ -0,0 +1,14 @@
+{
+  "__version__": {
+    "sentence_transformers": "5.1.0",
+    "transformers": "4.55.0",
+    "pytorch": "2.8.0+cu128"
+  },
+  "prompts": {
+    "query": "",
+    "document": ""
+  },
+  "default_prompt_name": null,
+  "similarity_fn_name": "cosine",
+  "model_type": "SentenceTransformer"
+}

model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:12173c7f242e7fb0c7eb4731687d0b8da0a05b9c3af38ec4e67b90cc6699952c
+size 596070136

modules.json

@@ -0,0 +1,20 @@
+[
+  {
+    "idx": 0,
+    "name": "0",
+    "path": "",
+    "type": "sentence_transformers.models.Transformer"
+  },
+  {
+    "idx": 1,
+    "name": "1",
+    "path": "1_Pooling",
+    "type": "sentence_transformers.models.Pooling"
+  },
+  {
+    "idx": 2,
+    "name": "2",
+    "path": "2_Normalize",
+    "type": "sentence_transformers.models.Normalize"
+  }
+]

sentence_bert_config.json

@@ -0,0 +1,4 @@
+{
+    "max_seq_length": 8192,
+    "do_lower_case": false
+}

special_tokens_map.json

@@ -0,0 +1,37 @@
+{
+  "cls_token": {
+    "content": "[CLS]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "mask_token": {
+    "content": "[MASK]",
+    "lstrip": true,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "[PAD]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "sep_token": {
+    "content": "[SEP]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "[UNK]",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer_config.json

@@ -0,0 +1,945 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "|||IP_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "1": {
+      "content": "<|padding|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50254": {
+      "content": "                        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50255": {
+      "content": "                       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50256": {
+      "content": "                      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50257": {
+      "content": "                     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50258": {
+      "content": "                    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50259": {
+      "content": "                   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50260": {
+      "content": "                  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50261": {
+      "content": "                 ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50262": {
+      "content": "                ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50263": {
+      "content": "               ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50264": {
+      "content": "              ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50265": {
+      "content": "             ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50266": {
+      "content": "            ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50267": {
+      "content": "           ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50268": {
+      "content": "          ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50269": {
+      "content": "         ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50270": {
+      "content": "        ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50271": {
+      "content": "       ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50272": {
+      "content": "      ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50273": {
+      "content": "     ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50274": {
+      "content": "    ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50275": {
+      "content": "   ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50276": {
+      "content": "  ",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50277": {
+      "content": "|||EMAIL_ADDRESS|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50278": {
+      "content": "|||PHONE_NUMBER|||",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50279": {
+      "content": "<|endoftext|>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50280": {
+      "content": "[UNK]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50281": {
+      "content": "[CLS]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50282": {
+      "content": "[SEP]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50283": {
+      "content": "[PAD]",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50284": {
+      "content": "[MASK]",
+      "lstrip": true,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "50285": {
+      "content": "[unused0]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50286": {
+      "content": "[unused1]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50287": {
+      "content": "[unused2]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50288": {
+      "content": "[unused3]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50289": {
+      "content": "[unused4]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50290": {
+      "content": "[unused5]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50291": {
+      "content": "[unused6]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50292": {
+      "content": "[unused7]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50293": {
+      "content": "[unused8]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50294": {
+      "content": "[unused9]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50295": {
+      "content": "[unused10]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50296": {
+      "content": "[unused11]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50297": {
+      "content": "[unused12]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50298": {
+      "content": "[unused13]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50299": {
+      "content": "[unused14]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50300": {
+      "content": "[unused15]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50301": {
+      "content": "[unused16]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50302": {
+      "content": "[unused17]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50303": {
+      "content": "[unused18]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50304": {
+      "content": "[unused19]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50305": {
+      "content": "[unused20]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50306": {
+      "content": "[unused21]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50307": {
+      "content": "[unused22]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50308": {
+      "content": "[unused23]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50309": {
+      "content": "[unused24]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50310": {
+      "content": "[unused25]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50311": {
+      "content": "[unused26]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50312": {
+      "content": "[unused27]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50313": {
+      "content": "[unused28]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50314": {
+      "content": "[unused29]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50315": {
+      "content": "[unused30]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50316": {
+      "content": "[unused31]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50317": {
+      "content": "[unused32]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50318": {
+      "content": "[unused33]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50319": {
+      "content": "[unused34]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50320": {
+      "content": "[unused35]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50321": {
+      "content": "[unused36]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50322": {
+      "content": "[unused37]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50323": {
+      "content": "[unused38]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50324": {
+      "content": "[unused39]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50325": {
+      "content": "[unused40]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50326": {
+      "content": "[unused41]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50327": {
+      "content": "[unused42]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50328": {
+      "content": "[unused43]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50329": {
+      "content": "[unused44]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50330": {
+      "content": "[unused45]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50331": {
+      "content": "[unused46]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50332": {
+      "content": "[unused47]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50333": {
+      "content": "[unused48]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50334": {
+      "content": "[unused49]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50335": {
+      "content": "[unused50]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50336": {
+      "content": "[unused51]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50337": {
+      "content": "[unused52]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50338": {
+      "content": "[unused53]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50339": {
+      "content": "[unused54]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50340": {
+      "content": "[unused55]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50341": {
+      "content": "[unused56]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50342": {
+      "content": "[unused57]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50343": {
+      "content": "[unused58]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50344": {
+      "content": "[unused59]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50345": {
+      "content": "[unused60]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50346": {
+      "content": "[unused61]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50347": {
+      "content": "[unused62]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50348": {
+      "content": "[unused63]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50349": {
+      "content": "[unused64]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50350": {
+      "content": "[unused65]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50351": {
+      "content": "[unused66]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50352": {
+      "content": "[unused67]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50353": {
+      "content": "[unused68]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50354": {
+      "content": "[unused69]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50355": {
+      "content": "[unused70]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50356": {
+      "content": "[unused71]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50357": {
+      "content": "[unused72]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50358": {
+      "content": "[unused73]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50359": {
+      "content": "[unused74]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50360": {
+      "content": "[unused75]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50361": {
+      "content": "[unused76]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50362": {
+      "content": "[unused77]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50363": {
+      "content": "[unused78]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50364": {
+      "content": "[unused79]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50365": {
+      "content": "[unused80]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50366": {
+      "content": "[unused81]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    },
+    "50367": {
+      "content": "[unused82]",
+      "lstrip": false,
+      "normalized": true,
+      "rstrip": false,
+      "single_word": false,
+      "special": false
+    }
+  },
+  "clean_up_tokenization_spaces": true,
+  "cls_token": "[CLS]",
+  "extra_special_tokens": {},
+  "mask_token": "[MASK]",
+  "model_input_names": [
+    "input_ids",
+    "attention_mask"
+  ],
+  "model_max_length": 8192,
+  "pad_token": "[PAD]",
+  "sep_token": "[SEP]",
+  "tokenizer_class": "PreTrainedTokenizerFast",
+  "unk_token": "[UNK]"
+}