| root@modalix:/mnt/ac# python3 -m sima_utils.transformer.devkit.devkit_demo --model_path demo_models--google--paligemma-3b-pt-224/ 2>&1 | tee console.log | |
| I/O error(2): No such file or directory | |
| VLM initialization starting ... | |
| VLM initialization completed. | |
| >>> set image samples/pipeline-cat-chonk.jpeg | |
| >>> Where is the cat standing? | |
| Query: Where is the cat standing? | |
| Assistant: snow | |
| TTFT: 0.50s | |
| TPS: avg=0.06, quantiles=['16.64'] | |
| >>> describe en | |
| Query: describe en | |
| Assistant: Manul in winter | |
| TTFT: 0.38s | |
| TPS: avg=17.02, quantiles=['17.05', '17.04', '17.03', '17.00'] | |
| >>> caption en | |
| Query: caption en | |
| Assistant: the lynx is a beautiful cat | |