v0.38.0
Browse filesSee https://github.com/quic/ai-hub-models/releases/v0.38.0 for changelog.
- LICENSE +1 -1
- README.md +32 -38
- Sequencer2D_float.dlc +2 -2
- Sequencer2D_float.onnx.zip +2 -2
- Sequencer2D_w8a8.onnx.zip +2 -2
- Sequencer2D_w8a8.tflite +1 -1
- precompiled/qualcomm-snapdragon-x-elite/Sequencer2D_float.bin +0 -3
- precompiled/qualcomm-snapdragon-x-elite/Sequencer2D_float.onnx.zip +0 -3
- precompiled/qualcomm-snapdragon-x-elite/tool-versions.yaml +0 -3
- tool-versions.yaml +1 -1
LICENSE
CHANGED
|
@@ -1,2 +1,2 @@
|
|
| 1 |
-
The license of the original trained model can be found at https://github.com/
|
| 2 |
The license for the deployable model files (.tflite, .onnx, .dlc, .bin, etc.) can be found in DEPLOYMENT_MODEL_LICENSE.pdf.
|
|
|
|
| 1 |
+
The license of the original trained model can be found at https://github.com/okojoalg/sequencer/blob/main/LICENSE.
|
| 2 |
The license for the deployable model files (.tflite, .onnx, .dlc, .bin, etc.) can be found in DEPLOYMENT_MODEL_LICENSE.pdf.
|
README.md
CHANGED
|
@@ -13,7 +13,7 @@ pipeline_tag: image-classification
|
|
| 13 |
## Imagenet classifier and general purpose backbone
|
| 14 |
|
| 15 |
|
| 16 |
-
|
| 17 |
|
| 18 |
This model is an implementation of Sequencer2D found [here](https://github.com/okojoalg/sequencer).
|
| 19 |
|
|
@@ -32,44 +32,38 @@ More details on model performance across various devices, can be found
|
|
| 32 |
- Input resolution: 224x224
|
| 33 |
- Number of parameters: 27.6M
|
| 34 |
- Model size (float): 106 MB
|
| 35 |
-
- Model size (
|
| 36 |
|
| 37 |
| Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
|
| 38 |
|---|---|---|---|---|---|---|---|---|
|
| 39 |
-
| Sequencer2D | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 116.
|
| 40 |
-
| Sequencer2D | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC |
|
| 41 |
-
| Sequencer2D | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 57.
|
| 42 |
-
| Sequencer2D | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC |
|
| 43 |
-
| Sequencer2D | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE |
|
| 44 |
-
| Sequencer2D | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC |
|
| 45 |
-
| Sequencer2D | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX |
|
| 46 |
-
| Sequencer2D | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE |
|
| 47 |
-
| Sequencer2D | float |
|
| 48 |
-
| Sequencer2D | float | Samsung Galaxy
|
| 49 |
-
| Sequencer2D | float | Samsung Galaxy
|
| 50 |
-
| Sequencer2D | float | Samsung Galaxy
|
| 51 |
-
| Sequencer2D | float | Samsung Galaxy
|
| 52 |
-
| Sequencer2D | float | Samsung Galaxy
|
| 53 |
-
| Sequencer2D | float |
|
| 54 |
-
| Sequencer2D | float | Snapdragon
|
| 55 |
-
| Sequencer2D |
|
| 56 |
-
| Sequencer2D |
|
| 57 |
-
| Sequencer2D |
|
| 58 |
-
| Sequencer2D |
|
| 59 |
-
| Sequencer2D | w8a8 |
|
| 60 |
-
| Sequencer2D | w8a8 |
|
| 61 |
-
| Sequencer2D | w8a8 |
|
| 62 |
-
| Sequencer2D | w8a8 |
|
| 63 |
-
| Sequencer2D | w8a8 |
|
| 64 |
-
| Sequencer2D | w8a8 |
|
| 65 |
-
| Sequencer2D | w8a8 |
|
| 66 |
-
| Sequencer2D | w8a8 |
|
| 67 |
-
| Sequencer2D | w8a8 | Samsung Galaxy S23 | Snapdragon® 8 Gen 2 Mobile | ONNX | 57.675 ms | 123 - 254 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
| 68 |
-
| Sequencer2D | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 32.596 ms | 0 - 497 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.tflite) |
|
| 69 |
-
| Sequencer2D | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 55.021 ms | 161 - 2609 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
| 70 |
-
| Sequencer2D | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | TFLITE | 31.918 ms | 0 - 487 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.tflite) |
|
| 71 |
-
| Sequencer2D | w8a8 | Snapdragon 8 Elite QRD | Snapdragon® 8 Elite Mobile | ONNX | 36.684 ms | 163 - 1165 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
| 72 |
-
| Sequencer2D | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 52.765 ms | 232 - 232 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
| 73 |
|
| 74 |
|
| 75 |
|
|
@@ -151,7 +145,7 @@ from qai_hub_models.models.sequencer2d import Model
|
|
| 151 |
torch_model = Model.from_pretrained()
|
| 152 |
|
| 153 |
# Device
|
| 154 |
-
device = hub.Device("Samsung Galaxy
|
| 155 |
|
| 156 |
# Trace model
|
| 157 |
input_shape = torch_model.get_input_spec()
|
|
@@ -244,7 +238,7 @@ Explore all available models on [Qualcomm® AI Hub](https://aihub.qualcomm.com/)
|
|
| 244 |
|
| 245 |
## License
|
| 246 |
* The license for the original implementation of Sequencer2D can be found
|
| 247 |
-
[here](https://github.com/
|
| 248 |
* The license for the compiled assets for on-device deployment can be found [here](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
|
| 249 |
|
| 250 |
|
|
|
|
| 13 |
## Imagenet classifier and general purpose backbone
|
| 14 |
|
| 15 |
|
| 16 |
+
Sequencer2D is a vision transformer model that can classify images from the Imagenet dataset.
|
| 17 |
|
| 18 |
This model is an implementation of Sequencer2D found [here](https://github.com/okojoalg/sequencer).
|
| 19 |
|
|
|
|
| 32 |
- Input resolution: 224x224
|
| 33 |
- Number of parameters: 27.6M
|
| 34 |
- Model size (float): 106 MB
|
| 35 |
+
- Model size (w8a8): 69.1 MB
|
| 36 |
|
| 37 |
| Model | Precision | Device | Chipset | Target Runtime | Inference Time (ms) | Peak Memory Range (MB) | Primary Compute Unit | Target Model
|
| 38 |
|---|---|---|---|---|---|---|---|---|
|
| 39 |
+
| Sequencer2D | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 116.656 ms | 0 - 542 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.tflite) |
|
| 40 |
+
| Sequencer2D | float | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | QNN_DLC | 59.22 ms | 1 - 805 MB | NPU | [Sequencer2D.dlc](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.dlc) |
|
| 41 |
+
| Sequencer2D | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 57.773 ms | 0 - 411 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.tflite) |
|
| 42 |
+
| Sequencer2D | float | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | QNN_DLC | 67.919 ms | 1 - 432 MB | NPU | [Sequencer2D.dlc](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.dlc) |
|
| 43 |
+
| Sequencer2D | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 60.096 ms | 0 - 70 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.tflite) |
|
| 44 |
+
| Sequencer2D | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | QNN_DLC | 22.679 ms | 0 - 107 MB | NPU | [Sequencer2D.dlc](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.dlc) |
|
| 45 |
+
| Sequencer2D | float | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 46.962 ms | 0 - 238 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.onnx.zip) |
|
| 46 |
+
| Sequencer2D | float | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 62.087 ms | 0 - 541 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.tflite) |
|
| 47 |
+
| Sequencer2D | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 43.924 ms | 0 - 543 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.tflite) |
|
| 48 |
+
| Sequencer2D | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | QNN_DLC | 15.732 ms | 1 - 1656 MB | NPU | [Sequencer2D.dlc](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.dlc) |
|
| 49 |
+
| Sequencer2D | float | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 33.638 ms | 1 - 872 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.onnx.zip) |
|
| 50 |
+
| Sequencer2D | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 37.148 ms | 0 - 537 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.tflite) |
|
| 51 |
+
| Sequencer2D | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | QNN_DLC | 14.601 ms | 0 - 803 MB | NPU | [Sequencer2D.dlc](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.dlc) |
|
| 52 |
+
| Sequencer2D | float | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 23.506 ms | 1 - 508 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.onnx.zip) |
|
| 53 |
+
| Sequencer2D | float | Snapdragon X Elite CRD | Snapdragon® X Elite | QNN_DLC | 23.775 ms | 830 - 830 MB | NPU | [Sequencer2D.dlc](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.dlc) |
|
| 54 |
+
| Sequencer2D | float | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 48.364 ms | 65 - 65 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D.onnx.zip) |
|
| 55 |
+
| Sequencer2D | w8a8 | QCS8275 (Proxy) | Qualcomm® QCS8275 (Proxy) | TFLITE | 82.339 ms | 0 - 486 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.tflite) |
|
| 56 |
+
| Sequencer2D | w8a8 | QCS8450 (Proxy) | Qualcomm® QCS8450 (Proxy) | TFLITE | 39.607 ms | 0 - 381 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.tflite) |
|
| 57 |
+
| Sequencer2D | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | TFLITE | 44.655 ms | 0 - 67 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.tflite) |
|
| 58 |
+
| Sequencer2D | w8a8 | QCS8550 (Proxy) | Qualcomm® QCS8550 (Proxy) | ONNX | 84.222 ms | 121 - 257 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
| 59 |
+
| Sequencer2D | w8a8 | QCS9075 (Proxy) | Qualcomm® QCS9075 (Proxy) | TFLITE | 45.772 ms | 0 - 485 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.tflite) |
|
| 60 |
+
| Sequencer2D | w8a8 | RB3 Gen 2 (Proxy) | Qualcomm® QCS6490 (Proxy) | ONNX | 262.468 ms | 20 - 41 MB | CPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
| 61 |
+
| Sequencer2D | w8a8 | RB5 (Proxy) | Qualcomm® QCS8250 (Proxy) | ONNX | 246.974 ms | 17 - 48 MB | CPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
| 62 |
+
| Sequencer2D | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | TFLITE | 32.408 ms | 0 - 490 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.tflite) |
|
| 63 |
+
| Sequencer2D | w8a8 | Samsung Galaxy S24 | Snapdragon® 8 Gen 3 Mobile | ONNX | 65.763 ms | 137 - 2462 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
| 64 |
+
| Sequencer2D | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | TFLITE | 26.784 ms | 0 - 480 MB | NPU | [Sequencer2D.tflite](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.tflite) |
|
| 65 |
+
| Sequencer2D | w8a8 | Samsung Galaxy S25 | Snapdragon® 8 Elite For Galaxy Mobile | ONNX | 58.447 ms | 160 - 712 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
| 66 |
+
| Sequencer2D | w8a8 | Snapdragon X Elite CRD | Snapdragon® X Elite | ONNX | 80.04 ms | 232 - 232 MB | NPU | [Sequencer2D.onnx.zip](https://huggingface.co/qualcomm/Sequencer2D/blob/main/Sequencer2D_w8a8.onnx.zip) |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 67 |
|
| 68 |
|
| 69 |
|
|
|
|
| 145 |
torch_model = Model.from_pretrained()
|
| 146 |
|
| 147 |
# Device
|
| 148 |
+
device = hub.Device("Samsung Galaxy S25")
|
| 149 |
|
| 150 |
# Trace model
|
| 151 |
input_shape = torch_model.get_input_spec()
|
|
|
|
| 238 |
|
| 239 |
## License
|
| 240 |
* The license for the original implementation of Sequencer2D can be found
|
| 241 |
+
[here](https://github.com/okojoalg/sequencer/blob/main/LICENSE).
|
| 242 |
* The license for the compiled assets for on-device deployment can be found [here](https://qaihub-public-assets.s3.us-west-2.amazonaws.com/qai-hub-models/Qualcomm+AI+Hub+Proprietary+License.pdf)
|
| 243 |
|
| 244 |
|
Sequencer2D_float.dlc
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:a9db2adcd035c34de7afc1743501f6c585e402a0b5c8519461d0dee33b4440de
|
| 3 |
+
size 123433188
|
Sequencer2D_float.onnx.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:8d2a0dec713da1b834f334ae009a2980b2bdbcca628e568303ee986e7ca267b8
|
| 3 |
+
size 102956358
|
Sequencer2D_w8a8.onnx.zip
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
-
size
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:e3c95075b3b6a958bedf05f20e7d4bd984dcb15c39236f6e24261012016ebb45
|
| 3 |
+
size 72139773
|
Sequencer2D_w8a8.tflite
CHANGED
|
@@ -1,3 +1,3 @@
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:
|
| 3 |
size 65551016
|
|
|
|
| 1 |
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:23992fc4fd4ffc02e8314f7809df8bbb0b363520c5ba2f5631494a287a7374b0
|
| 3 |
size 65551016
|
precompiled/qualcomm-snapdragon-x-elite/Sequencer2D_float.bin
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:cf9ddab8109edf3ee71d5483ffd8307591799b3cdf206507589cf07c743d4fae
|
| 3 |
-
size 66490368
|
|
|
|
|
|
|
|
|
|
|
|
precompiled/qualcomm-snapdragon-x-elite/Sequencer2D_float.onnx.zip
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
version https://git-lfs.github.com/spec/v1
|
| 2 |
-
oid sha256:41523ce15d512408ad21b3744be17f5207f24d45f23d74d4f719a563c6d71fb5
|
| 3 |
-
size 54937161
|
|
|
|
|
|
|
|
|
|
|
|
precompiled/qualcomm-snapdragon-x-elite/tool-versions.yaml
DELETED
|
@@ -1,3 +0,0 @@
|
|
| 1 |
-
tool_versions:
|
| 2 |
-
precompiled_qnn_onnx:
|
| 3 |
-
qairt: 2.36.4.250725200057_123280
|
|
|
|
|
|
|
|
|
|
|
|
tool-versions.yaml
CHANGED
|
@@ -1,4 +1,4 @@
|
|
| 1 |
tool_versions:
|
| 2 |
onnx:
|
| 3 |
-
qairt: 2.
|
| 4 |
onnx_runtime: 1.22.2
|
|
|
|
| 1 |
tool_versions:
|
| 2 |
onnx:
|
| 3 |
+
qairt: 2.37.1.250807093845_124904
|
| 4 |
onnx_runtime: 1.22.2
|