svjack commited on
Commit
e8702dd
·
verified ·
1 Parent(s): bed251d

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +55 -9
README.md CHANGED
@@ -52,13 +52,15 @@ Before proceeding, ensure that you have the following installed on your system:
52
 
53
  To generate a hold Sign Image, use the `fpack_generate_video.py` script with the appropriate parameters. Below are examples of how to do it.
54
 
 
55
  * 1
56
  - Mask
57
 
58
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/focqmsmaZtwaB6fn6RWZt.jpeg)
59
 
60
  ```python
61
- #In a gritty seinen manga panel, a grizzled detective holds the empty sign under the flickering neon lights of a rainy alleyway, the heavy crosshatching shadows obscuring half his scarred face while cigarette smoke curls around him.
 
62
  python fpack_generate_video.py \
63
  --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
64
  --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
@@ -66,7 +68,7 @@ python fpack_generate_video.py \
66
  --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
67
  --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
68
  --image_path mask.jpg \
69
- --prompt "In a gritty seinen manga panel, a grizzled detective holds the empty sign under the flickering neon lights of a rainy alleyway, the heavy crosshatching shadows obscuring half his scarred face while cigarette smoke curls around him." \
70
  --video_size 1088 1920 --fps 30 --infer_steps 25 \
71
  --attn_mode sdpa --fp8_scaled \
72
  --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
@@ -77,7 +79,7 @@ python fpack_generate_video.py \
77
 
78
  - Output
79
 
80
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/1qDE6HZ4ruwB16lsoOEF-.jpeg)
81
 
82
  * 2
83
  - Mask
@@ -110,11 +112,12 @@ python fpack_generate_video.py \
110
  * 3
111
  - Mask
112
 
113
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/zBPJ6kYRq-PIJB7AbuKUY.jpeg)
114
 
115
- ```python
116
- #A blacksmith manga artisan proudly holds the empty sign in their forge, the glowing metal textures contrasting with the dark, soot-stained walls.
117
 
 
 
118
  python fpack_generate_video.py \
119
  --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
120
  --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
@@ -122,7 +125,7 @@ python fpack_generate_video.py \
122
  --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
123
  --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
124
  --image_path mask.jpg \
125
- --prompt "A historical manga samurai holds the empty sign with quiet dignity amidst a shower of cherry blossoms, his tattered kimono sleeves fluttering in the wind as ink wash-style mountains loom in the background." \
126
  --video_size 1088 1920 --fps 30 --infer_steps 25 \
127
  --attn_mode sdpa --fp8_scaled \
128
  --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
@@ -133,4 +136,47 @@ python fpack_generate_video.py \
133
 
134
  - Output
135
 
136
- ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/mv1qv3hocT-T9PL_iD0mH.jpeg)
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
52
 
53
  To generate a hold Sign Image, use the `fpack_generate_video.py` script with the appropriate parameters. Below are examples of how to do it.
54
 
55
+
56
  * 1
57
  - Mask
58
 
59
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/zBPJ6kYRq-PIJB7AbuKUY.jpeg)
60
 
61
  ```python
62
+ #A blacksmith manga artisan proudly holds the empty sign in their forge, the glowing metal textures contrasting with the dark, soot-stained walls.
63
+
64
  python fpack_generate_video.py \
65
  --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
66
  --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
 
68
  --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
69
  --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
70
  --image_path mask.jpg \
71
+ --prompt "A historical manga samurai holds the empty sign with quiet dignity amidst a shower of cherry blossoms, his tattered kimono sleeves fluttering in the wind as ink wash-style mountains loom in the background." \
72
  --video_size 1088 1920 --fps 30 --infer_steps 25 \
73
  --attn_mode sdpa --fp8_scaled \
74
  --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
 
79
 
80
  - Output
81
 
82
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/mv1qv3hocT-T9PL_iD0mH.jpeg)
83
 
84
  * 2
85
  - Mask
 
112
  * 3
113
  - Mask
114
 
115
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/focqmsmaZtwaB6fn6RWZt.jpeg)
116
 
117
+ ** demo 1
 
118
 
119
+ ```python
120
+ #In a gritty seinen manga panel, a grizzled detective holds the empty sign under the flickering neon lights of a rainy alleyway, the heavy crosshatching shadows obscuring half his scarred face while cigarette smoke curls around him.
121
  python fpack_generate_video.py \
122
  --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
123
  --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
 
125
  --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
126
  --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
127
  --image_path mask.jpg \
128
+ --prompt "In a gritty seinen manga panel, a grizzled detective holds the empty sign under the flickering neon lights of a rainy alleyway, the heavy crosshatching shadows obscuring half his scarred face while cigarette smoke curls around him." \
129
  --video_size 1088 1920 --fps 30 --infer_steps 25 \
130
  --attn_mode sdpa --fp8_scaled \
131
  --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
 
136
 
137
  - Output
138
 
139
+ ![image/jpeg](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/1qDE6HZ4ruwB16lsoOEF-.jpeg)
140
+
141
+ ** demo 2 KAEDEHARA KAZUHA
142
+
143
+ - Image
144
+ ```python
145
+ python fpack_generate_video.py \
146
+ --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
147
+ --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
148
+ --text_encoder1 HunyuanVideo_repackaged/split_files/text_encoders/llava_llama3_fp16.safetensors \
149
+ --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
150
+ --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
151
+ --image_path mask.jpg \
152
+ --prompt "a young male anime character with white hair tied by a crimson ribbon, holds an empty sign, his red pupils etched with black patterns like secrets whispered in the dark. He walks alone through a maple forest, each step rustling the carpet of fallen leaves. The wind toys with his pale strands, the red ribbon flickering like flame against the gold-and-scarlet canopy. Sunlight filters through the branches, dappling his figure in amber as he catches a drifting leaf, tracing its veins with quiet amusement. Distant mountains blaze with autumn, yet he moves through the fiery woods—neither stranger nor native, just a silhouette woven into the season’s tapestry." \
153
+ --video_size 768 1024 --fps 30 --infer_steps 25 \
154
+ --attn_mode sdpa --fp8_scaled \
155
+ --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
156
+ --save_path save --video_sections 1 --output_type latent_images --one_frame_inference zero_post \
157
+ --seed 1234 --lora_multiplier 1.0 --lora_weight framepack_sign_output/framepack-sign-lora-000006.safetensors
158
+ ```
159
+
160
+
161
+ ![image/png](https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/6sSue65xkSygwRP6cy_rs.png)
162
+
163
+ - Video
164
+ ```python
165
+ python fpack_generate_video.py \
166
+ --dit FramePackI2V_HY/diffusion_pytorch_model-00001-of-00003.safetensors \
167
+ --vae HunyuanVideo/vae/diffusion_pytorch_model.safetensors \
168
+ --text_encoder1 HunyuanVideo_repackaged/split_files/text_encoders/llava_llama3_fp16.safetensors \
169
+ --text_encoder2 HunyuanVideo_repackaged/split_files/text_encoders/clip_l.safetensors \
170
+ --image_encoder sigclip_vision_384/sigclip_vision_patch14_384.safetensors \
171
+ --image_path mask.jpg \
172
+ --prompt "a young male anime character with white hair tied by a crimson ribbon, holds an empty sign, his red pupils etched with black patterns like secrets whispered in the dark. He walks alone through a maple forest, each step rustling the carpet of fallen leaves. The wind toys with his pale strands, the red ribbon flickering like flame against the gold-and-scarlet canopy. Sunlight filters through the branches, dappling his figure in amber as he catches a drifting leaf, tracing its veins with quiet amusement. Distant mountains blaze with autumn, yet he moves through the fiery woods—neither stranger nor native, just a silhouette woven into the season’s tapestry." \
173
+ --video_size 480 832 --video_seconds 3 --fps 30 --infer_steps 25 \
174
+ --attn_mode sdpa --fp8_scaled \
175
+ --vae_chunk_size 32 --vae_spatial_tile_sample_min_size 128 \
176
+ --save_path save --output_type video \
177
+ --seed 1234 --lora_multiplier 1.0 --lora_weight framepack_sign_output/framepack-sign-lora-000006.safetensors
178
+ ```
179
+
180
+
181
+ <video controls autoplay src="https://cdn-uploads.huggingface.co/production/uploads/634dffc49b777beec3bc6448/my1CuTt7hcFwhN3rS97k1.mp4"></video>
182
+