runtime error

Exit code: 1. Reason: | 4.23G/8.72G [00:06<00:07, 640MB/s] transformer/diffusion_pytorch_model-0000(…): 61%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ | 5.30G/8.72G [00:07<00:05, 676MB/s] transformer/diffusion_pytorch_model-0000(…): 73%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–Ž | 6.38G/8.72G [00:09<00:03, 680MB/s] transformer/diffusion_pytorch_model-0000(…): 82%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ– | 7.11G/8.72G [00:12<00:03, 432MB/s] transformer/diffusion_pytorch_model-0000(…): 100%|β–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆβ–ˆ| 8.72G/8.72G [00:13<00:00, 656MB/s] Traceback (most recent call last): File "/home/user/app/app.py", line 47, in <module> transformer=WanTransformer3DModel.from_pretrained('cbensimon/Wan2.2-I2V-A14B-bf16-Diffusers', File "/home/user/.pyenv/versions/3.10.18/lib/python3.10/site-packages/huggingface_hub/utils/_validators.py", line 114, in _inner_fn return fn(*args, **kwargs) File "/home/user/.pyenv/versions/3.10.18/lib/python3.10/site-packages/diffusers/models/modeling_utils.py", line 1288, in from_pretrained ) = cls._load_pretrained_model( File "/home/user/.pyenv/versions/3.10.18/lib/python3.10/site-packages/diffusers/models/modeling_utils.py", line 1537, in _load_pretrained_model _caching_allocator_warmup(model, expanded_device_map, dtype, hf_quantizer) File "/home/user/.pyenv/versions/3.10.18/lib/python3.10/site-packages/diffusers/models/model_loading_utils.py", line 748, in _caching_allocator_warmup _ = torch.empty(byte_count // factor, dtype=dtype, device=device, requires_grad=False) torch.OutOfMemoryError: CUDA out of memory. Tried to allocate 26.62 GiB. GPU 0 has a total capacity of 22.30 GiB of which 22.05 GiB is free. Process 2575409 has 248.00 MiB memory in use. Of the allocated memory 0 bytes is allocated by PyTorch, and 0 bytes is reserved by PyTorch but unallocated. If reserved but unallocated memory is large try setting PYTORCH_CUDA_ALLOC_CONF=expandable_segments:True to avoid fragmentation. See documentation for Memory Management (https://pytorch.org/docs/stable/notes/cuda.html#environment-variables)

Container logs:

Fetching error logs...