Add files using upload-large-folder tool

.gitattributes

@@ -33,3 +33,9 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text
 *.zip filter=lfs diff=lfs merge=lfs -text
 *.zst filter=lfs diff=lfs merge=lfs -text
 *tfevents* filter=lfs diff=lfs merge=lfs -text
+tokenizer/tokenizer.json filter=lfs diff=lfs merge=lfs -text
+assets/comp_effic.png filter=lfs diff=lfs merge=lfs -text
+assets/moe_2.png filter=lfs diff=lfs merge=lfs -text
+assets/performance.png filter=lfs diff=lfs merge=lfs -text
+assets/vae.png filter=lfs diff=lfs merge=lfs -text
+examples/i2v_input.JPG filter=lfs diff=lfs merge=lfs -text

README.md

@@ -0,0 +1,272 @@
+---
+license: apache-2.0
+language:
+- en
+- zh
+pipeline_tag: text-to-video
+---
+# Wan2.2
+
+<p align="center">
+    <img src="assets/logo.png" width="400"/>
+<p>
+
+<p align="center">
+    💜 <a href="https://wan.video"><b>Wan</b></a> &nbsp&nbsp ｜ &nbsp&nbsp 🖥️ <a href="https://github.com/Wan-Video/Wan2.2">GitHub</a> &nbsp&nbsp  | &nbsp&nbsp🤗 <a href="https://huggingface.co/Wan-AI/">Hugging Face</a>&nbsp&nbsp | &nbsp&nbsp🤖 <a href="https://modelscope.cn/organization/Wan-AI">ModelScope</a>&nbsp&nbsp | &nbsp&nbsp 📑 <a href="https://arxiv.org/abs/2503.20314">Technical Report</a> &nbsp&nbsp | &nbsp&nbsp 📑 <a href="https://wan.video/welcome?spm=a2ty_o02.30011076.0.0.6c9ee41eCcluqg">Blog</a> &nbsp&nbsp | &nbsp&nbsp💬 <a href="https://gw.alicdn.com/imgextra/i2/O1CN01tqjWFi1ByuyehkTSB_!!6000000000015-0-tps-611-1279.jpg">WeChat Group</a>&nbsp&nbsp | &nbsp&nbsp 📖 <a href="https://discord.gg/AKNgpMK4Yj">Discord</a>&nbsp&nbsp
+<br>
+
+-----
+
+[**Wan: Open and Advanced Large-Scale Video Generative Models**](https://arxiv.org/abs/2503.20314) <be>
+
+
+We are excited to introduce **Wan2.2**, a major upgrade to our foundational video models. With **Wan2.2**, we have focused on incorporating the following innovations:
+
+- 👍 **Effective MoE Architecture**: Wan2.2 introduces a Mixture-of-Experts (MoE) architecture into video diffusion models. By separating the denoising process cross timesteps with specialized powerful expert models, this enlarges the overall model capacity while maintaining the same computational cost.
+
+- 👍 **Cinematic-level Aesthetics**: Wan2.2 incorporates meticulously curated aesthetic data, complete with detailed labels for lighting, composition, contrast, color tone, and more. This allows for more precise and controllable cinematic style generation, facilitating the creation of videos with customizable aesthetic preferences.
+
+- 👍 **Complex Motion Generation**: Compared to Wan2.1, Wan2.2 is trained on a significantly larger data, with +65.6% more images and +83.2% more videos. This expansion notably enhances the model's generalization across multiple dimensions such as motions,  semantics, and aesthetics, achieving TOP performance among all open-sourced and closed-sourced models. 
+
+- 👍 **Efficient High-Definition Hybrid TI2V**:  Wan2.2 open-sources a 5B model built with our advanced Wan2.2-VAE that achieves a compression ratio of **16×16×4**. This model supports both text-to-video and image-to-video generation at 720P resolution with 24fps and can also run on consumer-grade graphics cards like 4090. It is one of the fastest **720P@24fps** models currently available, capable of serving both the industrial and academic sectors simultaneously.
+
+This repository contains our TI2V-5B model, built with the advanced Wan2.2-VAE that achieves a compression ratio of 16×16×4. This model supports both text-to-video and image-to-video generation at 720P resolution with 24fps and can runs on single consumer-grade GPU such as the 4090. It is one of the fastest 720P@24fps models available, meeting the needs of both industrial applications and academic research.
+
+
+
+## Video Demos
+
+<div align="center">
+    <video width="80%" controls>
+        <source src="https://cloud.video.taobao.com/vod/4szTT1B0LqXvJzmuEURfGRA-nllnqN_G2AT0ZWkQXoQ.mp4" type="video/mp4">
+        Your browser does not support the video tag.
+    </video>
+</div>
+
+
+## 🔥 Latest News!!
+
+* Jul 28, 2025: 👋 We've released the inference code and model weights of **Wan2.2**.
+
+## Community Works
+If your research or project builds upon [**Wan2.1**](https://github.com/Wan-Video/Wan2.1) or Wan2.2, we welcome you to share it with us so we can highlight it for the broader community.
+
+
+## 📑 Todo List
+- Wan2.2 Text-to-Video
+    - [x] Multi-GPU Inference code of the A14B and 14B models
+    - [x] Checkpoints of the A14B and 14B models
+    - [x] ComfyUI integration
+    - [x] Diffusers integration
+- Wan2.2 Image-to-Video
+    - [x] Multi-GPU Inference code of the A14B model
+    - [x] Checkpoints of the A14B model
+    - [x] ComfyUI integration
+    - [x] Diffusers integration
+- Wan2.2 Text-Image-to-Video
+    - [x] Multi-GPU Inference code of the 5B model
+    - [x] Checkpoints of the 5B model
+    - [x] ComfyUI integration
+    - [x] Diffusers integration
+
+## Run Wan2.2
+
+#### Installation
+Clone the repo:
+```sh
+git clone https://github.com/Wan-Video/Wan2.2.git
+cd Wan2.2
+```
+
+Install dependencies:
+```sh
+# Ensure torch >= 2.4.0
+pip install -r requirements.txt
+```
+
+
+#### Model Download
+
+
+| Models              | Download Links                                                                                                                              | Description |
+|--------------------|---------------------------------------------------------------------------------------------------------------------------------------------|-------------|
+| T2V-A14B    | 🤗 [Huggingface](https://huggingface.co/Wan-AI/Wan2.2-T2V-A14B)    🤖 [ModelScope](https://modelscope.cn/models/Wan-AI/Wan2.2-T2V-A14B)    | Text-to-Video MoE model, supports 480P & 720P |
+| I2V-A14B    | 🤗 [Huggingface](https://huggingface.co/Wan-AI/Wan2.2-I2V-A14B)    🤖 [ModelScope](https://modelscope.cn/models/Wan-AI/Wan2.2-I2V-A14B)    | Image-to-Video MoE model, supports 480P & 720P |
+| TI2V-5B     | 🤗 [Huggingface](https://huggingface.co/Wan-AI/Wan2.2-TI2V-5B)     🤖 [ModelScope](https://modelscope.cn/models/Wan-AI/Wan2.2-TI2V-5B)     | High-compression VAE, T2V+I2V, supports 720P |
+
+
+> 💡Note: 
+> The TI2V-5B model supports 720P video generation at **24 FPS**.
+
+
+Download models using huggingface-cli:
+``` sh
+pip install "huggingface_hub[cli]"
+huggingface-cli download Wan-AI/Wan2.2-TI2V-5B --local-dir ./Wan2.2-TI2V-5B
+```
+
+Download models using modelscope-cli:
+``` sh
+pip install modelscope
+modelscope download Wan-AI/Wan2.2-TI2V-5B --local_dir ./Wan2.2-TI2V-5B
+```
+
+#### Run Text-Image-to-Video Generation
+
+This repository supports the `Wan2.2-TI2V-5B` Text-Image-to-Video model and can support video generation at 720P resolutions.
+
+
+- Single-GPU Text-to-Video inference
+```sh
+python generate.py --task ti2v-5B --size 1280*704 --ckpt_dir ./Wan2.2-TI2V-5B --offload_model True --convert_model_dtype --t5_cpu --prompt "Two anthropomorphic cats in comfy boxing gear and bright gloves fight intensely on a spotlighted stage"
+```
+
+> 💡Unlike other tasks, the 720P resolution of the Text-Image-to-Video task is `1280*704` or `704*1280`.
+
+> This command can run on a GPU with at least 24GB VRAM (e.g, RTX 4090 GPU).
+
+> 💡If you are running on a GPU with at least 80GB VRAM, you can remove the `--offload_model True`, `--convert_model_dtype` and `--t5_cpu` options to speed up execution.
+
+
+- Single-GPU Image-to-Video inference
+```sh
+python generate.py --task ti2v-5B --size 1280*704 --ckpt_dir ./Wan2.2-TI2V-5B --offload_model True --convert_model_dtype --t5_cpu --image examples/i2v_input.JPG --prompt "Summer beach vacation style, a white cat wearing sunglasses sits on a surfboard. The fluffy-furred feline gazes directly at the camera with a relaxed expression. Blurred beach scenery forms the background featuring crystal-clear waters, distant green hills, and a blue sky dotted with white clouds. The cat assumes a naturally relaxed posture, as if savoring the sea breeze and warm sunlight. A close-up shot highlights the feline's intricate details and the refreshing atmosphere of the seaside."
+```
+
+> 💡If the image parameter is configured, it is an Image-to-Video generation; otherwise, it defaults to a Text-to-Video generation.
+
+> 💡Similar to Image-to-Video, the `size` parameter represents the area of the generated video, with the aspect ratio following that of the original input image.
+
+
+- Multi-GPU inference using FSDP + DeepSpeed Ulysses
+
+```sh
+torchrun --nproc_per_node=8 generate.py --task ti2v-5B --size 1280*704 --ckpt_dir ./Wan2.2-TI2V-5B --dit_fsdp --t5_fsdp --ulysses_size 8 --image examples/i2v_input.JPG --prompt "Summer beach vacation style, a white cat wearing sunglasses sits on a surfboard. The fluffy-furred feline gazes directly at the camera with a relaxed expression. Blurred beach scenery forms the background featuring crystal-clear waters, distant green hills, and a blue sky dotted with white clouds. The cat assumes a naturally relaxed posture, as if savoring the sea breeze and warm sunlight. A close-up shot highlights the feline's intricate details and the refreshing atmosphere of the seaside."
+```
+
+> The process of prompt extension can be referenced [here](#2-using-prompt-extention).
+
+
+- Running with Diffusers
+
+```py
+import torch
+import numpy as np
+from diffusers import WanPipeline, AutoencoderKLWan, WanTransformer3DModel, UniPCMultistepScheduler
+from diffusers.utils import export_to_video, load_image
+
+dtype = torch.bfloat16
+device = "cuda"
+
+model_id = "Wan-AI/Wan2.2-TI2V-5B-Diffusers"
+vae = AutoencoderKLWan.from_pretrained(model_id, subfolder="vae", torch_dtype=torch.float32)
+pipe = WanPipeline.from_pretrained(model_id, vae=vae, torch_dtype=dtype)
+pipe.to(device)
+
+height = 704
+width = 1280
+num_frames = 121
+num_inference_steps = 50
+guidance_scale = 5.0
+
+
+prompt = "Two anthropomorphic cats in comfy boxing gear and bright gloves fight intensely on a spotlighted stage."
+negative_prompt = "色调艳丽，过曝，静态，细节模糊不清，字幕，风格，作品，画作，画面，静止，整体发灰，最差质量，低质量，JPEG压缩残留，丑陋的，残缺的，多余的手指，画得不好的手部，画得不好的脸部，畸形的，毁容的，形态畸形的肢体，手指融合，静止不动的画面，杂乱的背景，三条腿，背景人很多，倒着走"
+
+output = pipe(
+    prompt=prompt,
+    negative_prompt=negative_prompt,
+    height=height,
+    width=width,
+    num_frames=num_frames,
+    guidance_scale=guidance_scale,
+    num_inference_steps=num_inference_steps,
+).frames[0]
+export_to_video(output, "5bit2v_output.mp4", fps=24)
+```
+
+
+
+
+## Computational Efficiency on Different GPUs
+
+We test the computational efficiency of different **Wan2.2** models on different GPUs in the following table. The results are presented in the format: **Total time (s) / peak GPU memory (GB)**.
+
+
+<div align="center">
+    <img src="assets/comp_effic.png" alt="" style="width: 80%;" />
+</div>
+
+> The parameter settings for the tests presented in this table are as follows:
+> (1) Multi-GPU: 14B: `--ulysses_size 4/8 --dit_fsdp --t5_fsdp`, 5B: `--ulysses_size 4/8 --offload_model True --convert_model_dtype --t5_cpu`; Single-GPU: 14B: `--offload_model True --convert_model_dtype`, 5B: `--offload_model True --convert_model_dtype --t5_cpu`
+(--convert_model_dtype converts model parameter types to config.param_dtype);
+> (2) The distributed testing utilizes the built-in FSDP and Ulysses implementations, with FlashAttention3 deployed on Hopper architecture GPUs;
+> (3) Tests were run without the `--use_prompt_extend` flag;
+> (4) Reported results are the average of multiple samples taken after the warm-up phase.
+
+
+-------
+
+## Introduction of Wan2.2
+
+**Wan2.2** builds on the foundation of Wan2.1 with notable improvements in generation quality and model capability. This upgrade is driven by a series of key technical innovations, mainly including the Mixture-of-Experts (MoE) architecture, upgraded training data, and high-compression video generation.
+
+##### (1) Mixture-of-Experts (MoE) Architecture
+
+Wan2.2 introduces Mixture-of-Experts (MoE) architecture into the video generation diffusion model. MoE has been widely validated in large language models as an efficient approach to increase total model parameters while keeping inference cost nearly unchanged. In Wan2.2, the A14B model series adopts a two-expert design tailored to the denoising process of diffusion models: a high-noise expert for the early stages, focusing on overall layout; and a low-noise expert for the later stages, refining video details. Each expert model has about 14B parameters, resulting in a total of 27B parameters but only 14B active parameters per step, keeping inference computation and GPU memory nearly unchanged.
+
+<div align="center">
+    <img src="assets/moe_arch.png" alt="" style="width: 90%;" />
+</div>
+
+The transition point between the two experts is determined by the signal-to-noise ratio (SNR), a metric that decreases monotonically as the denoising step $t$ increases. At the beginning of the denoising process, $t$ is large and the noise level is high, so the SNR is at its minimum, denoted as ${SNR}_{min}$. In this stage, the high-noise expert is activated. We define a threshold step ${t}_{moe}$ corresponding to half of the ${SNR}_{min}$, and switch to the low-noise expert when $t<{t}_{moe}$.
+
+<div align="center">
+    <img src="assets/moe_2.png" alt="" style="width: 90%;" />
+</div>
+
+To validate the effectiveness of the MoE architecture, four settings are compared based on their validation loss curves. The baseline **Wan2.1** model does not employ the MoE architecture. Among the MoE-based variants, the **Wan2.1 & High-Noise Expert** reuses the Wan2.1 model as the low-noise expert while uses the  Wan2.2's high-noise expert, while the **Wan2.1 & Low-Noise Expert** uses Wan2.1 as the high-noise expert and employ the Wan2.2's low-noise expert. The **Wan2.2 (MoE)** (our final version) achieves the lowest validation loss, indicating that its generated video distribution is closest to ground-truth and exhibits superior convergence.
+
+
+##### (2) Efficient High-Definition Hybrid TI2V
+To enable more efficient deployment, Wan2.2 also explores a high-compression design. In addition to the 27B MoE models, a 5B dense model, i.e., TI2V-5B, is released. It is supported by a high-compression Wan2.2-VAE, which achieves a $T\times H\times W$ compression ratio of $4\times16\times16$, increasing the overall compression rate to 64 while maintaining high-quality video reconstruction. With an additional patchification layer, the total compression ratio of TI2V-5B reaches $4\times32\times32$. Without specific optimization, TI2V-5B can generate a 5-second 720P video in under 9 minutes on a single consumer-grade GPU, ranking among the fastest 720P@24fps video generation models. This model also natively supports both text-to-video and image-to-video tasks within a single unified framework, covering both academic research and practical applications.
+
+
+<div align="center">
+    <img src="assets/vae.png" alt="" style="width: 80%;" />
+</div>
+
+
+
+##### Comparisons to SOTAs
+We compared Wan2.2 with leading closed-source commercial models on our new Wan-Bench 2.0, evaluating performance across multiple crucial dimensions. The results demonstrate that Wan2.2 achieves superior performance compared to these leading models.
+
+
+<div align="center">
+    <img src="assets/performance.png" alt="" style="width: 90%;" />
+</div>
+
+## Citation
+If you find our work helpful, please cite us.
+
+```
+@article{wan2025,
+      title={Wan: Open and Advanced Large-Scale Video Generative Models}, 
+      author={Team Wan and Ang Wang and Baole Ai and Bin Wen and Chaojie Mao and Chen-Wei Xie and Di Chen and Feiwu Yu and Haiming Zhao and Jianxiao Yang and Jianyuan Zeng and Jiayu Wang and Jingfeng Zhang and Jingren Zhou and Jinkai Wang and Jixuan Chen and Kai Zhu and Kang Zhao and Keyu Yan and Lianghua Huang and Mengyang Feng and Ningyi Zhang and Pandeng Li and Pingyu Wu and Ruihang Chu and Ruili Feng and Shiwei Zhang and Siyang Sun and Tao Fang and Tianxing Wang and Tianyi Gui and Tingyu Weng and Tong Shen and Wei Lin and Wei Wang and Wei Wang and Wenmeng Zhou and Wente Wang and Wenting Shen and Wenyuan Yu and Xianzhong Shi and Xiaoming Huang and Xin Xu and Yan Kou and Yangyu Lv and Yifei Li and Yijing Liu and Yiming Wang and Yingya Zhang and Yitong Huang and Yong Li and You Wu and Yu Liu and Yulin Pan and Yun Zheng and Yuntao Hong and Yupeng Shi and Yutong Feng and Zeyinzi Jiang and Zhen Han and Zhi-Fan Wu and Ziyu Liu},
+      journal = {arXiv preprint arXiv:2503.20314},
+      year={2025}
+}
+```
+
+## License Agreement
+The models in this repository are licensed under the Apache 2.0 License. We claim no rights over the your generated contents, granting you the freedom to use them while ensuring that your usage complies with the provisions of this license. You are fully accountable for your use of the models, which must not involve sharing any content that violates applicable laws, causes harm to individuals or groups, disseminates personal information intended for harm, spreads misinformation, or targets vulnerable populations. For a complete list of restrictions and details regarding your rights, please refer to the full text of the [license](LICENSE.txt).
+
+
+## Acknowledgements
+
+We would like to thank the contributors to the [SD3](https://huggingface.co/stabilityai/stable-diffusion-3-medium), [Qwen](https://huggingface.co/Qwen), [umt5-xxl](https://huggingface.co/google/umt5-xxl), [diffusers](https://github.com/huggingface/diffusers) and [HuggingFace](https://huggingface.co) repositories, for their open research.
+
+
+
+## Contact Us
+If you would like to leave a message to our research or product teams, feel free to join our [Discord](https://discord.gg/AKNgpMK4Yj) or [WeChat groups](https://gw.alicdn.com/imgextra/i2/O1CN01tqjWFi1ByuyehkTSB_!!6000000000015-0-tps-611-1279.jpg)!

model_index.json

@@ -0,0 +1,30 @@
+{
+  "_class_name": "WanPipeline",
+  "_diffusers_version": "0.35.0.dev0",
+  "boundary_ratio": null,
+  "expand_timesteps": true,
+  "scheduler": [
+    "diffusers",
+    "UniPCMultistepScheduler"
+  ],
+  "text_encoder": [
+    "transformers",
+    "UMT5EncoderModel"
+  ],
+  "tokenizer": [
+    "transformers",
+    "T5TokenizerFast"
+  ],
+  "transformer": [
+    "diffusers",
+    "WanTransformer3DModel"
+  ],
+  "transformer_2": [
+    null,
+    null
+  ],
+  "vae": [
+    "diffusers",
+    "AutoencoderKLWan"
+  ]
+}

scheduler/scheduler_config.json

@@ -0,0 +1,30 @@
+{
+  "_class_name": "UniPCMultistepScheduler",
+  "_diffusers_version": "0.35.0.dev0",
+  "beta_end": 0.02,
+  "beta_schedule": "linear",
+  "beta_start": 0.0001,
+  "disable_corrector": [],
+  "dynamic_thresholding_ratio": 0.995,
+  "final_sigmas_type": "zero",
+  "flow_shift": 5.0,
+  "lower_order_final": true,
+  "num_train_timesteps": 1000,
+  "predict_x0": true,
+  "prediction_type": "flow_prediction",
+  "rescale_betas_zero_snr": false,
+  "sample_max_value": 1.0,
+  "solver_order": 2,
+  "solver_p": null,
+  "solver_type": "bh2",
+  "steps_offset": 0,
+  "thresholding": false,
+  "time_shift_type": "exponential",
+  "timestep_spacing": "linspace",
+  "trained_betas": null,
+  "use_beta_sigmas": false,
+  "use_dynamic_shifting": false,
+  "use_exponential_sigmas": false,
+  "use_flow_sigmas": true,
+  "use_karras_sigmas": false
+}

text_encoder/config.json

@@ -0,0 +1,34 @@
+{
+  "_name_or_path": "google/umt5-xxl",
+  "architectures": [
+    "UMT5EncoderModel"
+  ],
+  "classifier_dropout": 0.0,
+  "d_ff": 10240,
+  "d_kv": 64,
+  "d_model": 4096,
+  "decoder_start_token_id": 0,
+  "dense_act_fn": "gelu_new",
+  "dropout_rate": 0.1,
+  "eos_token_id": 1,
+  "feed_forward_proj": "gated-gelu",
+  "initializer_factor": 1.0,
+  "is_encoder_decoder": true,
+  "is_gated_act": true,
+  "layer_norm_epsilon": 1e-06,
+  "model_type": "umt5",
+  "num_decoder_layers": 24,
+  "num_heads": 64,
+  "num_layers": 24,
+  "output_past": true,
+  "pad_token_id": 0,
+  "relative_attention_max_distance": 128,
+  "relative_attention_num_buckets": 32,
+  "scalable_attention": true,
+  "tie_word_embeddings": false,
+  "tokenizer_class": "T5Tokenizer",
+  "torch_dtype": "bfloat16",
+  "transformers_version": "4.48.0.dev0",
+  "use_cache": true,
+  "vocab_size": 256384
+}

text_encoder/model-00001-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a8e861969c7433e707cc5a74065d795d36cca07ec96eb6763eb4083df7248f58
+size 4935812536

text_encoder/model-00002-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:d57d948ece4837d850b7a859a4415121d57cacf8b9ee1d4db200c67f592902d7
+size 4983103192

text_encoder/model-00003-of-00003.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:0da9ee284e21d1406df708788db1d502d95d75f69faa25cd26151bf8829b7c5f
+size 1442935480

text_encoder/model.safetensors.index.json

@@ -0,0 +1,249 @@
+{
+  "metadata": {
+    "total_size": 11361820672
+  },
+  "weight_map": {
+    "encoder.block.0.layer.0.SelfAttention.k.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.0.layer.0.SelfAttention.o.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.0.layer.0.SelfAttention.q.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.0.layer.0.SelfAttention.relative_attention_bias.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.0.layer.0.SelfAttention.v.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.0.layer.0.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.0.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.0.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.0.layer.1.DenseReluDense.wo.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.0.layer.1.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.0.SelfAttention.k.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.0.SelfAttention.o.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.0.SelfAttention.q.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.0.SelfAttention.relative_attention_bias.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.0.SelfAttention.v.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.0.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.1.DenseReluDense.wo.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.1.layer.1.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.10.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.10.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.10.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.10.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.10.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.10.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.10.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.10.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.10.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.10.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.11.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.12.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.13.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.14.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.15.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.16.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.17.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.18.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.19.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.2.layer.0.SelfAttention.k.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.2.layer.0.SelfAttention.o.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.2.layer.0.SelfAttention.q.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.2.layer.0.SelfAttention.relative_attention_bias.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.2.layer.0.SelfAttention.v.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.2.layer.0.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.2.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.2.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.2.layer.1.DenseReluDense.wo.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.2.layer.1.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.20.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.20.layer.0.SelfAttention.o.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.20.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.20.layer.0.SelfAttention.relative_attention_bias.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.20.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.20.layer.0.layer_norm.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.20.layer.1.DenseReluDense.wi_0.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.20.layer.1.DenseReluDense.wi_1.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.20.layer.1.DenseReluDense.wo.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.20.layer.1.layer_norm.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.0.SelfAttention.k.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.0.SelfAttention.o.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.0.SelfAttention.q.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.0.SelfAttention.relative_attention_bias.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.0.SelfAttention.v.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.0.layer_norm.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.1.DenseReluDense.wi_0.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.1.DenseReluDense.wi_1.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.1.DenseReluDense.wo.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.21.layer.1.layer_norm.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.0.SelfAttention.k.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.0.SelfAttention.o.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.0.SelfAttention.q.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.0.SelfAttention.relative_attention_bias.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.0.SelfAttention.v.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.0.layer_norm.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.1.DenseReluDense.wi_0.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.1.DenseReluDense.wi_1.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.1.DenseReluDense.wo.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.22.layer.1.layer_norm.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.0.SelfAttention.k.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.0.SelfAttention.o.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.0.SelfAttention.q.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.0.SelfAttention.relative_attention_bias.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.0.SelfAttention.v.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.0.layer_norm.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.1.DenseReluDense.wi_0.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.1.DenseReluDense.wi_1.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.1.DenseReluDense.wo.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.23.layer.1.layer_norm.weight": "model-00003-of-00003.safetensors",
+    "encoder.block.3.layer.0.SelfAttention.k.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.3.layer.0.SelfAttention.o.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.3.layer.0.SelfAttention.q.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.3.layer.0.SelfAttention.relative_attention_bias.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.3.layer.0.SelfAttention.v.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.3.layer.0.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.3.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.3.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.3.layer.1.DenseReluDense.wo.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.3.layer.1.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.0.SelfAttention.k.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.0.SelfAttention.o.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.0.SelfAttention.q.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.0.SelfAttention.relative_attention_bias.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.0.SelfAttention.v.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.0.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.1.DenseReluDense.wo.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.4.layer.1.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.0.SelfAttention.k.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.0.SelfAttention.o.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.0.SelfAttention.q.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.0.SelfAttention.relative_attention_bias.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.0.SelfAttention.v.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.0.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.1.DenseReluDense.wo.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.5.layer.1.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.0.SelfAttention.k.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.0.SelfAttention.o.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.0.SelfAttention.q.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.0.SelfAttention.relative_attention_bias.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.0.SelfAttention.v.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.0.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.1.DenseReluDense.wi_0.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.1.DenseReluDense.wi_1.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.1.DenseReluDense.wo.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.6.layer.1.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.7.layer.0.SelfAttention.k.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.7.layer.0.SelfAttention.o.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.7.layer.0.SelfAttention.q.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.7.layer.0.SelfAttention.relative_attention_bias.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.7.layer.0.SelfAttention.v.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.7.layer.0.layer_norm.weight": "model-00001-of-00003.safetensors",
+    "encoder.block.7.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.7.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.7.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.7.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.8.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.0.SelfAttention.k.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.0.SelfAttention.o.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.0.SelfAttention.q.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.0.SelfAttention.relative_attention_bias.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.0.SelfAttention.v.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.0.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.1.DenseReluDense.wi_0.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.1.DenseReluDense.wi_1.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.1.DenseReluDense.wo.weight": "model-00002-of-00003.safetensors",
+    "encoder.block.9.layer.1.layer_norm.weight": "model-00002-of-00003.safetensors",
+    "encoder.final_layer_norm.weight": "model-00003-of-00003.safetensors",
+    "shared.weight": "model-00001-of-00003.safetensors"
+  }
+}

tokenizer/special_tokens_map.json

@@ -0,0 +1,332 @@
+{
+  "additional_special_tokens": [
+    "<extra_id_0>",
+    "<extra_id_1>",
+    "<extra_id_2>",
+    "<extra_id_3>",
+    "<extra_id_4>",
+    "<extra_id_5>",
+    "<extra_id_6>",
+    "<extra_id_7>",
+    "<extra_id_8>",
+    "<extra_id_9>",
+    "<extra_id_10>",
+    "<extra_id_11>",
+    "<extra_id_12>",
+    "<extra_id_13>",
+    "<extra_id_14>",
+    "<extra_id_15>",
+    "<extra_id_16>",
+    "<extra_id_17>",
+    "<extra_id_18>",
+    "<extra_id_19>",
+    "<extra_id_20>",
+    "<extra_id_21>",
+    "<extra_id_22>",
+    "<extra_id_23>",
+    "<extra_id_24>",
+    "<extra_id_25>",
+    "<extra_id_26>",
+    "<extra_id_27>",
+    "<extra_id_28>",
+    "<extra_id_29>",
+    "<extra_id_30>",
+    "<extra_id_31>",
+    "<extra_id_32>",
+    "<extra_id_33>",
+    "<extra_id_34>",
+    "<extra_id_35>",
+    "<extra_id_36>",
+    "<extra_id_37>",
+    "<extra_id_38>",
+    "<extra_id_39>",
+    "<extra_id_40>",
+    "<extra_id_41>",
+    "<extra_id_42>",
+    "<extra_id_43>",
+    "<extra_id_44>",
+    "<extra_id_45>",
+    "<extra_id_46>",
+    "<extra_id_47>",
+    "<extra_id_48>",
+    "<extra_id_49>",
+    "<extra_id_50>",
+    "<extra_id_51>",
+    "<extra_id_52>",
+    "<extra_id_53>",
+    "<extra_id_54>",
+    "<extra_id_55>",
+    "<extra_id_56>",
+    "<extra_id_57>",
+    "<extra_id_58>",
+    "<extra_id_59>",
+    "<extra_id_60>",
+    "<extra_id_61>",
+    "<extra_id_62>",
+    "<extra_id_63>",
+    "<extra_id_64>",
+    "<extra_id_65>",
+    "<extra_id_66>",
+    "<extra_id_67>",
+    "<extra_id_68>",
+    "<extra_id_69>",
+    "<extra_id_70>",
+    "<extra_id_71>",
+    "<extra_id_72>",
+    "<extra_id_73>",
+    "<extra_id_74>",
+    "<extra_id_75>",
+    "<extra_id_76>",
+    "<extra_id_77>",
+    "<extra_id_78>",
+    "<extra_id_79>",
+    "<extra_id_80>",
+    "<extra_id_81>",
+    "<extra_id_82>",
+    "<extra_id_83>",
+    "<extra_id_84>",
+    "<extra_id_85>",
+    "<extra_id_86>",
+    "<extra_id_87>",
+    "<extra_id_88>",
+    "<extra_id_89>",
+    "<extra_id_90>",
+    "<extra_id_91>",
+    "<extra_id_92>",
+    "<extra_id_93>",
+    "<extra_id_94>",
+    "<extra_id_95>",
+    "<extra_id_96>",
+    "<extra_id_97>",
+    "<extra_id_98>",
+    "<extra_id_99>",
+    "<extra_id_100>",
+    "<extra_id_101>",
+    "<extra_id_102>",
+    "<extra_id_103>",
+    "<extra_id_104>",
+    "<extra_id_105>",
+    "<extra_id_106>",
+    "<extra_id_107>",
+    "<extra_id_108>",
+    "<extra_id_109>",
+    "<extra_id_110>",
+    "<extra_id_111>",
+    "<extra_id_112>",
+    "<extra_id_113>",
+    "<extra_id_114>",
+    "<extra_id_115>",
+    "<extra_id_116>",
+    "<extra_id_117>",
+    "<extra_id_118>",
+    "<extra_id_119>",
+    "<extra_id_120>",
+    "<extra_id_121>",
+    "<extra_id_122>",
+    "<extra_id_123>",
+    "<extra_id_124>",
+    "<extra_id_125>",
+    "<extra_id_126>",
+    "<extra_id_127>",
+    "<extra_id_128>",
+    "<extra_id_129>",
+    "<extra_id_130>",
+    "<extra_id_131>",
+    "<extra_id_132>",
+    "<extra_id_133>",
+    "<extra_id_134>",
+    "<extra_id_135>",
+    "<extra_id_136>",
+    "<extra_id_137>",
+    "<extra_id_138>",
+    "<extra_id_139>",
+    "<extra_id_140>",
+    "<extra_id_141>",
+    "<extra_id_142>",
+    "<extra_id_143>",
+    "<extra_id_144>",
+    "<extra_id_145>",
+    "<extra_id_146>",
+    "<extra_id_147>",
+    "<extra_id_148>",
+    "<extra_id_149>",
+    "<extra_id_150>",
+    "<extra_id_151>",
+    "<extra_id_152>",
+    "<extra_id_153>",
+    "<extra_id_154>",
+    "<extra_id_155>",
+    "<extra_id_156>",
+    "<extra_id_157>",
+    "<extra_id_158>",
+    "<extra_id_159>",
+    "<extra_id_160>",
+    "<extra_id_161>",
+    "<extra_id_162>",
+    "<extra_id_163>",
+    "<extra_id_164>",
+    "<extra_id_165>",
+    "<extra_id_166>",
+    "<extra_id_167>",
+    "<extra_id_168>",
+    "<extra_id_169>",
+    "<extra_id_170>",
+    "<extra_id_171>",
+    "<extra_id_172>",
+    "<extra_id_173>",
+    "<extra_id_174>",
+    "<extra_id_175>",
+    "<extra_id_176>",
+    "<extra_id_177>",
+    "<extra_id_178>",
+    "<extra_id_179>",
+    "<extra_id_180>",
+    "<extra_id_181>",
+    "<extra_id_182>",
+    "<extra_id_183>",
+    "<extra_id_184>",
+    "<extra_id_185>",
+    "<extra_id_186>",
+    "<extra_id_187>",
+    "<extra_id_188>",
+    "<extra_id_189>",
+    "<extra_id_190>",
+    "<extra_id_191>",
+    "<extra_id_192>",
+    "<extra_id_193>",
+    "<extra_id_194>",
+    "<extra_id_195>",
+    "<extra_id_196>",
+    "<extra_id_197>",
+    "<extra_id_198>",
+    "<extra_id_199>",
+    "<extra_id_200>",
+    "<extra_id_201>",
+    "<extra_id_202>",
+    "<extra_id_203>",
+    "<extra_id_204>",
+    "<extra_id_205>",
+    "<extra_id_206>",
+    "<extra_id_207>",
+    "<extra_id_208>",
+    "<extra_id_209>",
+    "<extra_id_210>",
+    "<extra_id_211>",
+    "<extra_id_212>",
+    "<extra_id_213>",
+    "<extra_id_214>",
+    "<extra_id_215>",
+    "<extra_id_216>",
+    "<extra_id_217>",
+    "<extra_id_218>",
+    "<extra_id_219>",
+    "<extra_id_220>",
+    "<extra_id_221>",
+    "<extra_id_222>",
+    "<extra_id_223>",
+    "<extra_id_224>",
+    "<extra_id_225>",
+    "<extra_id_226>",
+    "<extra_id_227>",
+    "<extra_id_228>",
+    "<extra_id_229>",
+    "<extra_id_230>",
+    "<extra_id_231>",
+    "<extra_id_232>",
+    "<extra_id_233>",
+    "<extra_id_234>",
+    "<extra_id_235>",
+    "<extra_id_236>",
+    "<extra_id_237>",
+    "<extra_id_238>",
+    "<extra_id_239>",
+    "<extra_id_240>",
+    "<extra_id_241>",
+    "<extra_id_242>",
+    "<extra_id_243>",
+    "<extra_id_244>",
+    "<extra_id_245>",
+    "<extra_id_246>",
+    "<extra_id_247>",
+    "<extra_id_248>",
+    "<extra_id_249>",
+    "<extra_id_250>",
+    "<extra_id_251>",
+    "<extra_id_252>",
+    "<extra_id_253>",
+    "<extra_id_254>",
+    "<extra_id_255>",
+    "<extra_id_256>",
+    "<extra_id_257>",
+    "<extra_id_258>",
+    "<extra_id_259>",
+    "<extra_id_260>",
+    "<extra_id_261>",
+    "<extra_id_262>",
+    "<extra_id_263>",
+    "<extra_id_264>",
+    "<extra_id_265>",
+    "<extra_id_266>",
+    "<extra_id_267>",
+    "<extra_id_268>",
+    "<extra_id_269>",
+    "<extra_id_270>",
+    "<extra_id_271>",
+    "<extra_id_272>",
+    "<extra_id_273>",
+    "<extra_id_274>",
+    "<extra_id_275>",
+    "<extra_id_276>",
+    "<extra_id_277>",
+    "<extra_id_278>",
+    "<extra_id_279>",
+    "<extra_id_280>",
+    "<extra_id_281>",
+    "<extra_id_282>",
+    "<extra_id_283>",
+    "<extra_id_284>",
+    "<extra_id_285>",
+    "<extra_id_286>",
+    "<extra_id_287>",
+    "<extra_id_288>",
+    "<extra_id_289>",
+    "<extra_id_290>",
+    "<extra_id_291>",
+    "<extra_id_292>",
+    "<extra_id_293>",
+    "<extra_id_294>",
+    "<extra_id_295>",
+    "<extra_id_296>",
+    "<extra_id_297>",
+    "<extra_id_298>",
+    "<extra_id_299>"
+  ],
+  "bos_token": {
+    "content": "<s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "eos_token": {
+    "content": "</s>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "pad_token": {
+    "content": "<pad>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  },
+  "unk_token": {
+    "content": "<unk>",
+    "lstrip": false,
+    "normalized": false,
+    "rstrip": false,
+    "single_word": false
+  }
+}

tokenizer/spiece.model

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e3909a67b780650b35cf529ac782ad2b6b26e6d1f849d3fbb6a872905f452458
+size 4548313

tokenizer/tokenizer.json

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:20a46ac256746594ed7e1e3ef733b83fbc5a6f0922aa7480eda961743de080ef
+size 16837459

tokenizer/tokenizer_config.json

@@ -0,0 +1,2749 @@
+{
+  "added_tokens_decoder": {
+    "0": {
+      "content": "<pad>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "1": {
+      "content": "</s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "2": {
+      "content": "<s>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "3": {
+      "content": "<unk>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256000": {
+      "content": "<extra_id_299>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256001": {
+      "content": "<extra_id_298>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256002": {
+      "content": "<extra_id_297>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256003": {
+      "content": "<extra_id_296>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256004": {
+      "content": "<extra_id_295>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256005": {
+      "content": "<extra_id_294>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256006": {
+      "content": "<extra_id_293>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256007": {
+      "content": "<extra_id_292>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256008": {
+      "content": "<extra_id_291>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256009": {
+      "content": "<extra_id_290>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256010": {
+      "content": "<extra_id_289>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256011": {
+      "content": "<extra_id_288>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256012": {
+      "content": "<extra_id_287>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256013": {
+      "content": "<extra_id_286>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256014": {
+      "content": "<extra_id_285>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256015": {
+      "content": "<extra_id_284>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256016": {
+      "content": "<extra_id_283>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256017": {
+      "content": "<extra_id_282>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256018": {
+      "content": "<extra_id_281>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256019": {
+      "content": "<extra_id_280>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256020": {
+      "content": "<extra_id_279>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256021": {
+      "content": "<extra_id_278>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256022": {
+      "content": "<extra_id_277>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256023": {
+      "content": "<extra_id_276>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256024": {
+      "content": "<extra_id_275>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256025": {
+      "content": "<extra_id_274>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256026": {
+      "content": "<extra_id_273>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256027": {
+      "content": "<extra_id_272>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256028": {
+      "content": "<extra_id_271>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256029": {
+      "content": "<extra_id_270>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256030": {
+      "content": "<extra_id_269>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256031": {
+      "content": "<extra_id_268>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256032": {
+      "content": "<extra_id_267>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256033": {
+      "content": "<extra_id_266>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256034": {
+      "content": "<extra_id_265>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256035": {
+      "content": "<extra_id_264>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256036": {
+      "content": "<extra_id_263>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256037": {
+      "content": "<extra_id_262>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256038": {
+      "content": "<extra_id_261>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256039": {
+      "content": "<extra_id_260>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256040": {
+      "content": "<extra_id_259>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256041": {
+      "content": "<extra_id_258>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256042": {
+      "content": "<extra_id_257>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256043": {
+      "content": "<extra_id_256>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256044": {
+      "content": "<extra_id_255>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256045": {
+      "content": "<extra_id_254>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256046": {
+      "content": "<extra_id_253>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256047": {
+      "content": "<extra_id_252>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256048": {
+      "content": "<extra_id_251>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256049": {
+      "content": "<extra_id_250>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256050": {
+      "content": "<extra_id_249>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256051": {
+      "content": "<extra_id_248>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256052": {
+      "content": "<extra_id_247>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256053": {
+      "content": "<extra_id_246>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256054": {
+      "content": "<extra_id_245>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256055": {
+      "content": "<extra_id_244>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256056": {
+      "content": "<extra_id_243>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256057": {
+      "content": "<extra_id_242>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256058": {
+      "content": "<extra_id_241>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256059": {
+      "content": "<extra_id_240>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256060": {
+      "content": "<extra_id_239>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256061": {
+      "content": "<extra_id_238>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256062": {
+      "content": "<extra_id_237>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256063": {
+      "content": "<extra_id_236>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256064": {
+      "content": "<extra_id_235>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256065": {
+      "content": "<extra_id_234>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256066": {
+      "content": "<extra_id_233>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256067": {
+      "content": "<extra_id_232>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256068": {
+      "content": "<extra_id_231>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256069": {
+      "content": "<extra_id_230>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256070": {
+      "content": "<extra_id_229>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256071": {
+      "content": "<extra_id_228>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256072": {
+      "content": "<extra_id_227>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256073": {
+      "content": "<extra_id_226>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256074": {
+      "content": "<extra_id_225>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256075": {
+      "content": "<extra_id_224>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256076": {
+      "content": "<extra_id_223>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256077": {
+      "content": "<extra_id_222>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256078": {
+      "content": "<extra_id_221>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256079": {
+      "content": "<extra_id_220>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256080": {
+      "content": "<extra_id_219>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256081": {
+      "content": "<extra_id_218>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256082": {
+      "content": "<extra_id_217>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256083": {
+      "content": "<extra_id_216>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256084": {
+      "content": "<extra_id_215>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256085": {
+      "content": "<extra_id_214>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256086": {
+      "content": "<extra_id_213>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256087": {
+      "content": "<extra_id_212>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256088": {
+      "content": "<extra_id_211>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256089": {
+      "content": "<extra_id_210>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256090": {
+      "content": "<extra_id_209>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256091": {
+      "content": "<extra_id_208>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256092": {
+      "content": "<extra_id_207>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256093": {
+      "content": "<extra_id_206>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256094": {
+      "content": "<extra_id_205>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256095": {
+      "content": "<extra_id_204>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256096": {
+      "content": "<extra_id_203>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256097": {
+      "content": "<extra_id_202>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256098": {
+      "content": "<extra_id_201>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256099": {
+      "content": "<extra_id_200>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256100": {
+      "content": "<extra_id_199>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256101": {
+      "content": "<extra_id_198>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256102": {
+      "content": "<extra_id_197>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256103": {
+      "content": "<extra_id_196>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256104": {
+      "content": "<extra_id_195>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256105": {
+      "content": "<extra_id_194>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256106": {
+      "content": "<extra_id_193>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256107": {
+      "content": "<extra_id_192>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256108": {
+      "content": "<extra_id_191>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256109": {
+      "content": "<extra_id_190>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256110": {
+      "content": "<extra_id_189>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256111": {
+      "content": "<extra_id_188>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256112": {
+      "content": "<extra_id_187>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256113": {
+      "content": "<extra_id_186>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256114": {
+      "content": "<extra_id_185>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256115": {
+      "content": "<extra_id_184>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256116": {
+      "content": "<extra_id_183>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256117": {
+      "content": "<extra_id_182>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256118": {
+      "content": "<extra_id_181>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256119": {
+      "content": "<extra_id_180>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256120": {
+      "content": "<extra_id_179>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256121": {
+      "content": "<extra_id_178>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256122": {
+      "content": "<extra_id_177>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256123": {
+      "content": "<extra_id_176>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256124": {
+      "content": "<extra_id_175>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256125": {
+      "content": "<extra_id_174>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256126": {
+      "content": "<extra_id_173>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256127": {
+      "content": "<extra_id_172>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256128": {
+      "content": "<extra_id_171>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256129": {
+      "content": "<extra_id_170>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256130": {
+      "content": "<extra_id_169>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256131": {
+      "content": "<extra_id_168>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256132": {
+      "content": "<extra_id_167>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256133": {
+      "content": "<extra_id_166>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256134": {
+      "content": "<extra_id_165>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256135": {
+      "content": "<extra_id_164>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256136": {
+      "content": "<extra_id_163>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256137": {
+      "content": "<extra_id_162>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256138": {
+      "content": "<extra_id_161>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256139": {
+      "content": "<extra_id_160>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256140": {
+      "content": "<extra_id_159>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256141": {
+      "content": "<extra_id_158>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256142": {
+      "content": "<extra_id_157>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256143": {
+      "content": "<extra_id_156>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256144": {
+      "content": "<extra_id_155>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256145": {
+      "content": "<extra_id_154>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256146": {
+      "content": "<extra_id_153>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256147": {
+      "content": "<extra_id_152>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256148": {
+      "content": "<extra_id_151>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256149": {
+      "content": "<extra_id_150>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256150": {
+      "content": "<extra_id_149>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256151": {
+      "content": "<extra_id_148>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256152": {
+      "content": "<extra_id_147>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256153": {
+      "content": "<extra_id_146>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256154": {
+      "content": "<extra_id_145>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256155": {
+      "content": "<extra_id_144>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256156": {
+      "content": "<extra_id_143>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256157": {
+      "content": "<extra_id_142>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256158": {
+      "content": "<extra_id_141>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256159": {
+      "content": "<extra_id_140>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256160": {
+      "content": "<extra_id_139>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256161": {
+      "content": "<extra_id_138>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256162": {
+      "content": "<extra_id_137>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256163": {
+      "content": "<extra_id_136>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256164": {
+      "content": "<extra_id_135>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256165": {
+      "content": "<extra_id_134>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256166": {
+      "content": "<extra_id_133>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256167": {
+      "content": "<extra_id_132>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256168": {
+      "content": "<extra_id_131>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256169": {
+      "content": "<extra_id_130>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256170": {
+      "content": "<extra_id_129>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256171": {
+      "content": "<extra_id_128>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256172": {
+      "content": "<extra_id_127>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256173": {
+      "content": "<extra_id_126>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256174": {
+      "content": "<extra_id_125>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256175": {
+      "content": "<extra_id_124>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256176": {
+      "content": "<extra_id_123>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256177": {
+      "content": "<extra_id_122>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256178": {
+      "content": "<extra_id_121>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256179": {
+      "content": "<extra_id_120>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256180": {
+      "content": "<extra_id_119>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256181": {
+      "content": "<extra_id_118>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256182": {
+      "content": "<extra_id_117>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256183": {
+      "content": "<extra_id_116>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256184": {
+      "content": "<extra_id_115>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256185": {
+      "content": "<extra_id_114>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256186": {
+      "content": "<extra_id_113>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256187": {
+      "content": "<extra_id_112>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256188": {
+      "content": "<extra_id_111>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256189": {
+      "content": "<extra_id_110>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256190": {
+      "content": "<extra_id_109>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256191": {
+      "content": "<extra_id_108>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256192": {
+      "content": "<extra_id_107>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256193": {
+      "content": "<extra_id_106>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256194": {
+      "content": "<extra_id_105>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256195": {
+      "content": "<extra_id_104>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256196": {
+      "content": "<extra_id_103>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256197": {
+      "content": "<extra_id_102>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256198": {
+      "content": "<extra_id_101>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256199": {
+      "content": "<extra_id_100>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256200": {
+      "content": "<extra_id_99>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256201": {
+      "content": "<extra_id_98>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256202": {
+      "content": "<extra_id_97>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256203": {
+      "content": "<extra_id_96>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256204": {
+      "content": "<extra_id_95>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256205": {
+      "content": "<extra_id_94>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256206": {
+      "content": "<extra_id_93>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256207": {
+      "content": "<extra_id_92>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256208": {
+      "content": "<extra_id_91>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256209": {
+      "content": "<extra_id_90>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256210": {
+      "content": "<extra_id_89>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256211": {
+      "content": "<extra_id_88>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256212": {
+      "content": "<extra_id_87>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256213": {
+      "content": "<extra_id_86>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256214": {
+      "content": "<extra_id_85>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256215": {
+      "content": "<extra_id_84>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256216": {
+      "content": "<extra_id_83>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256217": {
+      "content": "<extra_id_82>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256218": {
+      "content": "<extra_id_81>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256219": {
+      "content": "<extra_id_80>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256220": {
+      "content": "<extra_id_79>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256221": {
+      "content": "<extra_id_78>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256222": {
+      "content": "<extra_id_77>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256223": {
+      "content": "<extra_id_76>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256224": {
+      "content": "<extra_id_75>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256225": {
+      "content": "<extra_id_74>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256226": {
+      "content": "<extra_id_73>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256227": {
+      "content": "<extra_id_72>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256228": {
+      "content": "<extra_id_71>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256229": {
+      "content": "<extra_id_70>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256230": {
+      "content": "<extra_id_69>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256231": {
+      "content": "<extra_id_68>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256232": {
+      "content": "<extra_id_67>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256233": {
+      "content": "<extra_id_66>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256234": {
+      "content": "<extra_id_65>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256235": {
+      "content": "<extra_id_64>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256236": {
+      "content": "<extra_id_63>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256237": {
+      "content": "<extra_id_62>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256238": {
+      "content": "<extra_id_61>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256239": {
+      "content": "<extra_id_60>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256240": {
+      "content": "<extra_id_59>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256241": {
+      "content": "<extra_id_58>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256242": {
+      "content": "<extra_id_57>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256243": {
+      "content": "<extra_id_56>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256244": {
+      "content": "<extra_id_55>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256245": {
+      "content": "<extra_id_54>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256246": {
+      "content": "<extra_id_53>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256247": {
+      "content": "<extra_id_52>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256248": {
+      "content": "<extra_id_51>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256249": {
+      "content": "<extra_id_50>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256250": {
+      "content": "<extra_id_49>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256251": {
+      "content": "<extra_id_48>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256252": {
+      "content": "<extra_id_47>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256253": {
+      "content": "<extra_id_46>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256254": {
+      "content": "<extra_id_45>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256255": {
+      "content": "<extra_id_44>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256256": {
+      "content": "<extra_id_43>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256257": {
+      "content": "<extra_id_42>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256258": {
+      "content": "<extra_id_41>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256259": {
+      "content": "<extra_id_40>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256260": {
+      "content": "<extra_id_39>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256261": {
+      "content": "<extra_id_38>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256262": {
+      "content": "<extra_id_37>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256263": {
+      "content": "<extra_id_36>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256264": {
+      "content": "<extra_id_35>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256265": {
+      "content": "<extra_id_34>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256266": {
+      "content": "<extra_id_33>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256267": {
+      "content": "<extra_id_32>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256268": {
+      "content": "<extra_id_31>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256269": {
+      "content": "<extra_id_30>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256270": {
+      "content": "<extra_id_29>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256271": {
+      "content": "<extra_id_28>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256272": {
+      "content": "<extra_id_27>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256273": {
+      "content": "<extra_id_26>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256274": {
+      "content": "<extra_id_25>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256275": {
+      "content": "<extra_id_24>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256276": {
+      "content": "<extra_id_23>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256277": {
+      "content": "<extra_id_22>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256278": {
+      "content": "<extra_id_21>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256279": {
+      "content": "<extra_id_20>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256280": {
+      "content": "<extra_id_19>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256281": {
+      "content": "<extra_id_18>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256282": {
+      "content": "<extra_id_17>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256283": {
+      "content": "<extra_id_16>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256284": {
+      "content": "<extra_id_15>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256285": {
+      "content": "<extra_id_14>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256286": {
+      "content": "<extra_id_13>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256287": {
+      "content": "<extra_id_12>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256288": {
+      "content": "<extra_id_11>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256289": {
+      "content": "<extra_id_10>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256290": {
+      "content": "<extra_id_9>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256291": {
+      "content": "<extra_id_8>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256292": {
+      "content": "<extra_id_7>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256293": {
+      "content": "<extra_id_6>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256294": {
+      "content": "<extra_id_5>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256295": {
+      "content": "<extra_id_4>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256296": {
+      "content": "<extra_id_3>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256297": {
+      "content": "<extra_id_2>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256298": {
+      "content": "<extra_id_1>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    },
+    "256299": {
+      "content": "<extra_id_0>",
+      "lstrip": false,
+      "normalized": false,
+      "rstrip": false,
+      "single_word": false,
+      "special": true
+    }
+  },
+  "additional_special_tokens": [
+    "<extra_id_0>",
+    "<extra_id_1>",
+    "<extra_id_2>",
+    "<extra_id_3>",
+    "<extra_id_4>",
+    "<extra_id_5>",
+    "<extra_id_6>",
+    "<extra_id_7>",
+    "<extra_id_8>",
+    "<extra_id_9>",
+    "<extra_id_10>",
+    "<extra_id_11>",
+    "<extra_id_12>",
+    "<extra_id_13>",
+    "<extra_id_14>",
+    "<extra_id_15>",
+    "<extra_id_16>",
+    "<extra_id_17>",
+    "<extra_id_18>",
+    "<extra_id_19>",
+    "<extra_id_20>",
+    "<extra_id_21>",
+    "<extra_id_22>",
+    "<extra_id_23>",
+    "<extra_id_24>",
+    "<extra_id_25>",
+    "<extra_id_26>",
+    "<extra_id_27>",
+    "<extra_id_28>",
+    "<extra_id_29>",
+    "<extra_id_30>",
+    "<extra_id_31>",
+    "<extra_id_32>",
+    "<extra_id_33>",
+    "<extra_id_34>",
+    "<extra_id_35>",
+    "<extra_id_36>",
+    "<extra_id_37>",
+    "<extra_id_38>",
+    "<extra_id_39>",
+    "<extra_id_40>",
+    "<extra_id_41>",
+    "<extra_id_42>",
+    "<extra_id_43>",
+    "<extra_id_44>",
+    "<extra_id_45>",
+    "<extra_id_46>",
+    "<extra_id_47>",
+    "<extra_id_48>",
+    "<extra_id_49>",
+    "<extra_id_50>",
+    "<extra_id_51>",
+    "<extra_id_52>",
+    "<extra_id_53>",
+    "<extra_id_54>",
+    "<extra_id_55>",
+    "<extra_id_56>",
+    "<extra_id_57>",
+    "<extra_id_58>",
+    "<extra_id_59>",
+    "<extra_id_60>",
+    "<extra_id_61>",
+    "<extra_id_62>",
+    "<extra_id_63>",
+    "<extra_id_64>",
+    "<extra_id_65>",
+    "<extra_id_66>",
+    "<extra_id_67>",
+    "<extra_id_68>",
+    "<extra_id_69>",
+    "<extra_id_70>",
+    "<extra_id_71>",
+    "<extra_id_72>",
+    "<extra_id_73>",
+    "<extra_id_74>",
+    "<extra_id_75>",
+    "<extra_id_76>",
+    "<extra_id_77>",
+    "<extra_id_78>",
+    "<extra_id_79>",
+    "<extra_id_80>",
+    "<extra_id_81>",
+    "<extra_id_82>",
+    "<extra_id_83>",
+    "<extra_id_84>",
+    "<extra_id_85>",
+    "<extra_id_86>",
+    "<extra_id_87>",
+    "<extra_id_88>",
+    "<extra_id_89>",
+    "<extra_id_90>",
+    "<extra_id_91>",
+    "<extra_id_92>",
+    "<extra_id_93>",
+    "<extra_id_94>",
+    "<extra_id_95>",
+    "<extra_id_96>",
+    "<extra_id_97>",
+    "<extra_id_98>",
+    "<extra_id_99>",
+    "<extra_id_100>",
+    "<extra_id_101>",
+    "<extra_id_102>",
+    "<extra_id_103>",
+    "<extra_id_104>",
+    "<extra_id_105>",
+    "<extra_id_106>",
+    "<extra_id_107>",
+    "<extra_id_108>",
+    "<extra_id_109>",
+    "<extra_id_110>",
+    "<extra_id_111>",
+    "<extra_id_112>",
+    "<extra_id_113>",
+    "<extra_id_114>",
+    "<extra_id_115>",
+    "<extra_id_116>",
+    "<extra_id_117>",
+    "<extra_id_118>",
+    "<extra_id_119>",
+    "<extra_id_120>",
+    "<extra_id_121>",
+    "<extra_id_122>",
+    "<extra_id_123>",
+    "<extra_id_124>",
+    "<extra_id_125>",
+    "<extra_id_126>",
+    "<extra_id_127>",
+    "<extra_id_128>",
+    "<extra_id_129>",
+    "<extra_id_130>",
+    "<extra_id_131>",
+    "<extra_id_132>",
+    "<extra_id_133>",
+    "<extra_id_134>",
+    "<extra_id_135>",
+    "<extra_id_136>",
+    "<extra_id_137>",
+    "<extra_id_138>",
+    "<extra_id_139>",
+    "<extra_id_140>",
+    "<extra_id_141>",
+    "<extra_id_142>",
+    "<extra_id_143>",
+    "<extra_id_144>",
+    "<extra_id_145>",
+    "<extra_id_146>",
+    "<extra_id_147>",
+    "<extra_id_148>",
+    "<extra_id_149>",
+    "<extra_id_150>",
+    "<extra_id_151>",
+    "<extra_id_152>",
+    "<extra_id_153>",
+    "<extra_id_154>",
+    "<extra_id_155>",
+    "<extra_id_156>",
+    "<extra_id_157>",
+    "<extra_id_158>",
+    "<extra_id_159>",
+    "<extra_id_160>",
+    "<extra_id_161>",
+    "<extra_id_162>",
+    "<extra_id_163>",
+    "<extra_id_164>",
+    "<extra_id_165>",
+    "<extra_id_166>",
+    "<extra_id_167>",
+    "<extra_id_168>",
+    "<extra_id_169>",
+    "<extra_id_170>",
+    "<extra_id_171>",
+    "<extra_id_172>",
+    "<extra_id_173>",
+    "<extra_id_174>",
+    "<extra_id_175>",
+    "<extra_id_176>",
+    "<extra_id_177>",
+    "<extra_id_178>",
+    "<extra_id_179>",
+    "<extra_id_180>",
+    "<extra_id_181>",
+    "<extra_id_182>",
+    "<extra_id_183>",
+    "<extra_id_184>",
+    "<extra_id_185>",
+    "<extra_id_186>",
+    "<extra_id_187>",
+    "<extra_id_188>",
+    "<extra_id_189>",
+    "<extra_id_190>",
+    "<extra_id_191>",
+    "<extra_id_192>",
+    "<extra_id_193>",
+    "<extra_id_194>",
+    "<extra_id_195>",
+    "<extra_id_196>",
+    "<extra_id_197>",
+    "<extra_id_198>",
+    "<extra_id_199>",
+    "<extra_id_200>",
+    "<extra_id_201>",
+    "<extra_id_202>",
+    "<extra_id_203>",
+    "<extra_id_204>",
+    "<extra_id_205>",
+    "<extra_id_206>",
+    "<extra_id_207>",
+    "<extra_id_208>",
+    "<extra_id_209>",
+    "<extra_id_210>",
+    "<extra_id_211>",
+    "<extra_id_212>",
+    "<extra_id_213>",
+    "<extra_id_214>",
+    "<extra_id_215>",
+    "<extra_id_216>",
+    "<extra_id_217>",
+    "<extra_id_218>",
+    "<extra_id_219>",
+    "<extra_id_220>",
+    "<extra_id_221>",
+    "<extra_id_222>",
+    "<extra_id_223>",
+    "<extra_id_224>",
+    "<extra_id_225>",
+    "<extra_id_226>",
+    "<extra_id_227>",
+    "<extra_id_228>",
+    "<extra_id_229>",
+    "<extra_id_230>",
+    "<extra_id_231>",
+    "<extra_id_232>",
+    "<extra_id_233>",
+    "<extra_id_234>",
+    "<extra_id_235>",
+    "<extra_id_236>",
+    "<extra_id_237>",
+    "<extra_id_238>",
+    "<extra_id_239>",
+    "<extra_id_240>",
+    "<extra_id_241>",
+    "<extra_id_242>",
+    "<extra_id_243>",
+    "<extra_id_244>",
+    "<extra_id_245>",
+    "<extra_id_246>",
+    "<extra_id_247>",
+    "<extra_id_248>",
+    "<extra_id_249>",
+    "<extra_id_250>",
+    "<extra_id_251>",
+    "<extra_id_252>",
+    "<extra_id_253>",
+    "<extra_id_254>",
+    "<extra_id_255>",
+    "<extra_id_256>",
+    "<extra_id_257>",
+    "<extra_id_258>",
+    "<extra_id_259>",
+    "<extra_id_260>",
+    "<extra_id_261>",
+    "<extra_id_262>",
+    "<extra_id_263>",
+    "<extra_id_264>",
+    "<extra_id_265>",
+    "<extra_id_266>",
+    "<extra_id_267>",
+    "<extra_id_268>",
+    "<extra_id_269>",
+    "<extra_id_270>",
+    "<extra_id_271>",
+    "<extra_id_272>",
+    "<extra_id_273>",
+    "<extra_id_274>",
+    "<extra_id_275>",
+    "<extra_id_276>",
+    "<extra_id_277>",
+    "<extra_id_278>",
+    "<extra_id_279>",
+    "<extra_id_280>",
+    "<extra_id_281>",
+    "<extra_id_282>",
+    "<extra_id_283>",
+    "<extra_id_284>",
+    "<extra_id_285>",
+    "<extra_id_286>",
+    "<extra_id_287>",
+    "<extra_id_288>",
+    "<extra_id_289>",
+    "<extra_id_290>",
+    "<extra_id_291>",
+    "<extra_id_292>",
+    "<extra_id_293>",
+    "<extra_id_294>",
+    "<extra_id_295>",
+    "<extra_id_296>",
+    "<extra_id_297>",
+    "<extra_id_298>",
+    "<extra_id_299>"
+  ],
+  "bos_token": "<s>",
+  "clean_up_tokenization_spaces": true,
+  "eos_token": "</s>",
+  "extra_ids": 300,
+  "extra_special_tokens": {},
+  "model_max_length": 1000000000000000019884624838656,
+  "pad_token": "<pad>",
+  "sp_model_kwargs": {},
+  "spaces_between_special_tokens": false,
+  "tokenizer_class": "T5Tokenizer",
+  "unk_token": "<unk>"
+}

transformer/config.json

@@ -0,0 +1,24 @@
+{
+  "_class_name": "WanTransformer3DModel",
+  "_diffusers_version": "0.35.0.dev0",
+  "added_kv_proj_dim": null,
+  "attention_head_dim": 128,
+  "cross_attn_norm": true,
+  "eps": 1e-06,
+  "ffn_dim": 14336,
+  "freq_dim": 256,
+  "image_dim": null,
+  "in_channels": 48,
+  "num_attention_heads": 24,
+  "num_layers": 30,
+  "out_channels": 48,
+  "patch_size": [
+    1,
+    2,
+    2
+  ],
+  "pos_embed_seq_len": null,
+  "qk_norm": "rms_norm_across_heads",
+  "rope_max_seq_len": 1024,
+  "text_dim": 4096
+}

transformer/diffusion_pytorch_model-00001-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:511bec832a201caa410d09c5ce7dbbf8ad2708c345d82038f684fc74cce982be
+size 4978254344

transformer/diffusion_pytorch_model-00002-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:7c42724912b1911429125dc50c0e9a49ccbada5a601b657d4ed2e15e7597c193
+size 4846784976

transformer/diffusion_pytorch_model-00003-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:e9c3d0c76de786566382f8258101fea973ae37681c6e9fe0e5fe1fb93b806424
+size 4972658392

transformer/diffusion_pytorch_model-00004-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:a331121771790939678db6f585553fd5184609f7d02593c699a4d241b0d834c5
+size 4846785080

transformer/diffusion_pytorch_model-00005-of-00005.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:78b655685c47efdb2349f36826bb101264e9f212a16325d584aeb5f53c88e719
+size 354751840

transformer/diffusion_pytorch_model.safetensors.index.json

@@ -0,0 +1,832 @@
+{
+  "metadata": {
+    "total_size": 19999150848
+  },
+  "weight_map": {
+    "blocks.0.attn1.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn1.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn1.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn1.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn1.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn1.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn1.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn1.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn1.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn1.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.attn2.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.ffn.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.ffn.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.ffn.net.2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.ffn.net.2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.norm2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.norm2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.0.scale_shift_table": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn1.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.attn2.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.ffn.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.ffn.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.ffn.net.2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.ffn.net.2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.norm2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.norm2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.1.scale_shift_table": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.10.attn1.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn1.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn1.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn1.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn1.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn1.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn1.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn1.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn1.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn1.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.attn2.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.ffn.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.ffn.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.ffn.net.2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.ffn.net.2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.norm2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.norm2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.10.scale_shift_table": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn1.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.attn2.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.ffn.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.ffn.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.ffn.net.2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.ffn.net.2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.norm2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.norm2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.11.scale_shift_table": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn1.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.attn2.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.ffn.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.ffn.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.ffn.net.2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.ffn.net.2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.norm2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.norm2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.12.scale_shift_table": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn1.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.attn2.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.ffn.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.ffn.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.ffn.net.2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.ffn.net.2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.norm2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.norm2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.13.scale_shift_table": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn1.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.attn2.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.ffn.net.0.proj.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.14.ffn.net.0.proj.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.14.ffn.net.2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.14.ffn.net.2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.14.norm2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.norm2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.14.scale_shift_table": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.15.attn1.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn1.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn1.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn1.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn1.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn1.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn1.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn1.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn1.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn1.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.attn2.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.ffn.net.0.proj.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.ffn.net.0.proj.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.ffn.net.2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.ffn.net.2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.norm2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.norm2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.15.scale_shift_table": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn1.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.attn2.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.ffn.net.0.proj.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.ffn.net.0.proj.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.ffn.net.2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.ffn.net.2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.norm2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.norm2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.16.scale_shift_table": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn1.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.attn2.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.ffn.net.0.proj.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.ffn.net.0.proj.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.ffn.net.2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.ffn.net.2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.norm2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.norm2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.17.scale_shift_table": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn1.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.attn2.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.ffn.net.0.proj.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.ffn.net.0.proj.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.ffn.net.2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.ffn.net.2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.norm2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.norm2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.18.scale_shift_table": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn1.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.attn2.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.ffn.net.0.proj.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.ffn.net.0.proj.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.ffn.net.2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.ffn.net.2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.norm2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.norm2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.19.scale_shift_table": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.2.attn1.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn1.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn1.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn1.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn1.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn1.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn1.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn1.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn1.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn1.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.attn2.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.ffn.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.ffn.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.ffn.net.2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.ffn.net.2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.norm2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.norm2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.2.scale_shift_table": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.20.attn1.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn1.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn1.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn1.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn1.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn1.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn1.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn1.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn1.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn1.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.attn2.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.ffn.net.0.proj.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.ffn.net.0.proj.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.ffn.net.2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.ffn.net.2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.norm2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.norm2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.20.scale_shift_table": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn1.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.to_k.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.to_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.to_out.0.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.to_out.0.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.to_v.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.attn2.to_v.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.ffn.net.0.proj.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.ffn.net.0.proj.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.ffn.net.2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.ffn.net.2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.norm2.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.norm2.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.21.scale_shift_table": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.22.attn1.norm_k.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.22.attn1.norm_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.22.attn1.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn1.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn1.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn1.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn1.to_q.bias": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.22.attn1.to_q.weight": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.22.attn1.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn1.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.attn2.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.ffn.net.0.proj.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.ffn.net.0.proj.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.ffn.net.2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.ffn.net.2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.norm2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.norm2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.22.scale_shift_table": "diffusion_pytorch_model-00003-of-00005.safetensors",
+    "blocks.23.attn1.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn1.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn1.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn1.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn1.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn1.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn1.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn1.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn1.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn1.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.attn2.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.ffn.net.0.proj.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.ffn.net.0.proj.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.ffn.net.2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.ffn.net.2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.norm2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.norm2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.23.scale_shift_table": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn1.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.attn2.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.ffn.net.0.proj.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.ffn.net.0.proj.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.ffn.net.2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.ffn.net.2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.norm2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.norm2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.24.scale_shift_table": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn1.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.attn2.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.ffn.net.0.proj.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.ffn.net.0.proj.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.ffn.net.2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.ffn.net.2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.norm2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.norm2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.25.scale_shift_table": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn1.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.attn2.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.ffn.net.0.proj.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.ffn.net.0.proj.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.ffn.net.2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.ffn.net.2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.norm2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.norm2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.26.scale_shift_table": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn1.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.attn2.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.ffn.net.0.proj.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.ffn.net.0.proj.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.ffn.net.2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.ffn.net.2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.norm2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.norm2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.27.scale_shift_table": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn1.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.attn2.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.ffn.net.0.proj.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.ffn.net.0.proj.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.ffn.net.2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.ffn.net.2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.norm2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.norm2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.28.scale_shift_table": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn1.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.norm_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.norm_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.to_k.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.to_k.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.to_out.0.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.to_out.0.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.to_q.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.to_q.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.to_v.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.attn2.to_v.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.ffn.net.0.proj.bias": "diffusion_pytorch_model-00005-of-00005.safetensors",
+    "blocks.29.ffn.net.0.proj.weight": "diffusion_pytorch_model-00005-of-00005.safetensors",
+    "blocks.29.ffn.net.2.bias": "diffusion_pytorch_model-00005-of-00005.safetensors",
+    "blocks.29.ffn.net.2.weight": "diffusion_pytorch_model-00005-of-00005.safetensors",
+    "blocks.29.norm2.bias": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.norm2.weight": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.29.scale_shift_table": "diffusion_pytorch_model-00004-of-00005.safetensors",
+    "blocks.3.attn1.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn1.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn1.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn1.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn1.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn1.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn1.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn1.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn1.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn1.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.attn2.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.ffn.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.ffn.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.ffn.net.2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.ffn.net.2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.norm2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.norm2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.3.scale_shift_table": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn1.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.attn2.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.ffn.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.ffn.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.ffn.net.2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.ffn.net.2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.norm2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.norm2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.4.scale_shift_table": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn1.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.attn2.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.ffn.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.ffn.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.ffn.net.2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.ffn.net.2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.norm2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.norm2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.5.scale_shift_table": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn1.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.to_k.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.to_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.to_out.0.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.to_out.0.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.to_v.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.attn2.to_v.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.ffn.net.0.proj.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.ffn.net.0.proj.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.ffn.net.2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.ffn.net.2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.norm2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.norm2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.6.scale_shift_table": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.7.attn1.norm_k.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.7.attn1.norm_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.7.attn1.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn1.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn1.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn1.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn1.to_q.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.7.attn1.to_q.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.7.attn1.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn1.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.attn2.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.ffn.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.ffn.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.ffn.net.2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.ffn.net.2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.norm2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.norm2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.7.scale_shift_table": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "blocks.8.attn1.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn1.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn1.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn1.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn1.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn1.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn1.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn1.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn1.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn1.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.attn2.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.ffn.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.ffn.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.ffn.net.2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.ffn.net.2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.norm2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.norm2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.8.scale_shift_table": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn1.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.norm_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.norm_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.to_k.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.to_k.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.to_out.0.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.to_out.0.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.to_q.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.to_q.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.to_v.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.attn2.to_v.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.ffn.net.0.proj.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.ffn.net.0.proj.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.ffn.net.2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.ffn.net.2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.norm2.bias": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.norm2.weight": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "blocks.9.scale_shift_table": "diffusion_pytorch_model-00002-of-00005.safetensors",
+    "condition_embedder.text_embedder.linear_1.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "condition_embedder.text_embedder.linear_1.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "condition_embedder.text_embedder.linear_2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "condition_embedder.text_embedder.linear_2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "condition_embedder.time_embedder.linear_1.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "condition_embedder.time_embedder.linear_1.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "condition_embedder.time_embedder.linear_2.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "condition_embedder.time_embedder.linear_2.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "condition_embedder.time_proj.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "condition_embedder.time_proj.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "patch_embedding.bias": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "patch_embedding.weight": "diffusion_pytorch_model-00001-of-00005.safetensors",
+    "proj_out.bias": "diffusion_pytorch_model-00005-of-00005.safetensors",
+    "proj_out.weight": "diffusion_pytorch_model-00005-of-00005.safetensors",
+    "scale_shift_table": "diffusion_pytorch_model-00001-of-00005.safetensors"
+  }
+}

vae/config.json

@@ -0,0 +1,128 @@
+{
+  "_class_name": "AutoencoderKLWan",
+  "_diffusers_version": "0.35.0.dev0",
+  "attn_scales": [],
+  "base_dim": 160,
+  "clip_output": false,
+  "decoder_base_dim": 256,
+  "dim_mult": [
+    1,
+    2,
+    4,
+    4
+  ],
+  "dropout": 0.0,
+  "in_channels": 12,
+  "is_residual": true,
+  "latents_mean": [
+    -0.2289,
+    -0.0052,
+    -0.1323,
+    -0.2339,
+    -0.2799,
+    0.0174,
+    0.1838,
+    0.1557,
+    -0.1382,
+    0.0542,
+    0.2813,
+    0.0891,
+    0.157,
+    -0.0098,
+    0.0375,
+    -0.1825,
+    -0.2246,
+    -0.1207,
+    -0.0698,
+    0.5109,
+    0.2665,
+    -0.2108,
+    -0.2158,
+    0.2502,
+    -0.2055,
+    -0.0322,
+    0.1109,
+    0.1567,
+    -0.0729,
+    0.0899,
+    -0.2799,
+    -0.123,
+    -0.0313,
+    -0.1649,
+    0.0117,
+    0.0723,
+    -0.2839,
+    -0.2083,
+    -0.052,
+    0.3748,
+    0.0152,
+    0.1957,
+    0.1433,
+    -0.2944,
+    0.3573,
+    -0.0548,
+    -0.1681,
+    -0.0667
+  ],
+  "latents_std": [
+    0.4765,
+    1.0364,
+    0.4514,
+    1.1677,
+    0.5313,
+    0.499,
+    0.4818,
+    0.5013,
+    0.8158,
+    1.0344,
+    0.5894,
+    1.0901,
+    0.6885,
+    0.6165,
+    0.8454,
+    0.4978,
+    0.5759,
+    0.3523,
+    0.7135,
+    0.6804,
+    0.5833,
+    1.4146,
+    0.8986,
+    0.5659,
+    0.7069,
+    0.5338,
+    0.4889,
+    0.4917,
+    0.4069,
+    0.4999,
+    0.6866,
+    0.4093,
+    0.5709,
+    0.6065,
+    0.6415,
+    0.4944,
+    0.5726,
+    1.2042,
+    0.5458,
+    1.6887,
+    0.3971,
+    1.06,
+    0.3943,
+    0.5537,
+    0.5444,
+    0.4089,
+    0.7468,
+    0.7744
+  ],
+  "num_res_blocks": 2,
+  "out_channels": 12,
+  "patch_size": 2,
+  "scale_factor_spatial": 16,
+  "scale_factor_temporal": 4,
+  "temperal_downsample": [
+    false,
+    true,
+    true
+  ],
+  "z_dim": 48
+}

vae/diffusion_pytorch_model.safetensors

@@ -0,0 +1,3 @@
+version https://git-lfs.github.com/spec/v1
+oid sha256:62cd18f19438e35b32ac63020e2852f566e9b02f46b6cdbd87972a356e3c6f4b
+size 2818777808