Update README.md
Browse files
README.md
CHANGED
|
@@ -52,13 +52,15 @@ Before proceeding, ensure that you have the following installed on your system:
|
|
| 52 |
|
| 53 |
To generate a hold Sign Image, use the `fpack_generate_video.py` script with the appropriate parameters. Below are examples of how to do it.
|
| 54 |
|
|
|
|
| 55 |
* 1
|
| 56 |
- Mask
|
| 57 |
|
| 58 |
-

|
| 60 |
|
| 61 |
```python
|
| 62 |
+
#A blacksmith manga artisan proudly holds the empty sign in their forge, the glowing metal textures contrasting with the dark, soot-stained walls.
|
| 63 |
+
|
| 64 |
python fpack_generate_video.py \
|
| 65 |
--dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
|
| 66 |
--vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
|
|
|
|
| 68 |
--text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
|
| 69 |
--image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
|
| 70 |
--image_path mask.jpg \
|
| 71 |
+
--prompt "A historical manga samurai holds the empty sign with quiet dignity amidst a shower of cherry blossoms, his tattered kimono sleeves fluttering in the wind as ink wash-style mountains loom in the background." \
|
| 72 |
--video_size 1088 1920 --fps 30 --infer_steps 25 \
|
| 73 |
--attn_mode sdpa --fp8_scaled \
|
| 74 |
--vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
|
|
|
|
| 79 |
|
| 80 |
- Output
|
| 81 |
|
| 82 |
+

|
| 83 |
|
| 84 |
* 2
|
| 85 |
- Mask
|
|
|
|
| 112 |
* 3
|
| 113 |
- Mask
|
| 114 |
|
| 115 |
+

|
| 116 |
|
| 117 |
+
** demo 1
|
|
|
|
| 118 |
|
| 119 |
+
```python
|
| 120 |
+
#In a gritty seinen manga panel, a grizzled detective holds the empty sign under the flickering neon lights of a rainy alleyway, the heavy crosshatching shadows obscuring half his scarred face while cigarette smoke curls around him.
|
| 121 |
python fpack_generate_video.py \
|
| 122 |
--dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
|
| 123 |
--vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
|
|
|
|
| 125 |
--text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
|
| 126 |
--image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
|
| 127 |
--image_path mask.jpg \
|
| 128 |
+
--prompt "In a gritty seinen manga panel, a grizzled detective holds the empty sign under the flickering neon lights of a rainy alleyway, the heavy crosshatching shadows obscuring half his scarred face while cigarette smoke curls around him." \
|
| 129 |
--video_size 1088 1920 --fps 30 --infer_steps 25 \
|
| 130 |
--attn_mode sdpa --fp8_scaled \
|
| 131 |
--vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
|
|
|
|
| 136 |
|
| 137 |
- Output
|
| 138 |
|
| 139 |
+

|
| 140 |
+
|
| 141 |
+
** demo 2 KAEDEHARA KAZUHA
|
| 142 |
+
|
| 143 |
+
- Image
|
| 144 |
+
```python
|
| 145 |
+
python fpack_generate_video.py \
|
| 146 |
+
--dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
|
| 147 |
+
--vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
|
| 148 |
+
--text_encoder1 HunyuanVideo_repackaged/split_files/text_encoders/llava_llama3_fp16.safetensors \
|
| 149 |
+
--text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
|
| 150 |
+
--image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
|
| 151 |
+
--image_path mask.jpg \
|
| 152 |
+
--prompt "a young male anime character with white hair tied by a crimson ribbon, holds an empty sign, his red pupils etched with black patterns like secrets whispered in the dark. He walks alone through a maple forest, each step rustling the carpet of fallen leaves. The wind toys with his pale strands, the red ribbon flickering like flame against the gold-and-scarlet canopy. Sunlight filters through the branches, dappling his figure in amber as he catches a drifting leaf, tracing its veins with quiet amusement. Distant mountains blaze with autumn, yet he moves through the fiery woods—neither stranger nor native, just a silhouette woven into the season’s tapestry." \
|
| 153 |
+
--video_size 768 1024 --fps 30 --infer_steps 25 \
|
| 154 |
+
--attn_mode sdpa --fp8_scaled \
|
| 155 |
+
--vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
|
| 156 |
+
--save_path save --video_sections 1 --output_type latent_images --one_frame_inference zero_post \
|
| 157 |
+
--seed 1234 --lora_multiplier 1.0 --lora_weight framepack_sign_output/framepack-sign-lora-000006.safetensors
|
| 158 |
+
```
|
| 159 |
+
|
| 160 |
+
|
| 161 |
+

|
| 162 |
+
|
| 163 |
+
- Video
|
| 164 |
+
```python
|
| 165 |
+
python fpack_generate_video.py \
|
| 166 |
+
--dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
|
| 167 |
+
--vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
|
| 168 |
+
--text_encoder1 HunyuanVideo_repackaged/split_files/text_encoders/llava_llama3_fp16.safetensors \
|
| 169 |
+
--text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
|
| 170 |
+
--image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
|
| 171 |
+
--image_path mask.jpg \
|
| 172 |
+
--prompt "a young male anime character with white hair tied by a crimson ribbon, holds an empty sign, his red pupils etched with black patterns like secrets whispered in the dark. He walks alone through a maple forest, each step rustling the carpet of fallen leaves. The wind toys with his pale strands, the red ribbon flickering like flame against the gold-and-scarlet canopy. Sunlight filters through the branches, dappling his figure in amber as he catches a drifting leaf, tracing its veins with quiet amusement. Distant mountains blaze with autumn, yet he moves through the fiery woods—neither stranger nor native, just a silhouette woven into the season’s tapestry." \
|
| 173 |
+
--video_size 480 832 --video_seconds 3 --fps 30 --infer_steps 25 \
|
| 174 |
+
--attn_mode sdpa --fp8_scaled \
|
| 175 |
+
--vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
|
| 176 |
+
--save_path save --output_type video \
|
| 177 |
+
--seed 1234 --lora_multiplier 1.0 --lora_weight framepack_sign_output/framepack-sign-lora-000006.safetensors
|
| 178 |
+
```
|
| 179 |
+
|
| 180 |
+
|
| 181 |
+
<video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/my1CuTt7hcFwhN3rS97k1.mp4"></video>
|
| 182 |
+
|