Update README.md
Browse files
README.md
CHANGED
|
@@ -12,17 +12,33 @@ pipeline_tag: image-text-to-text
|
|
| 12 |
|
| 13 |
# LeroyDyer/Mixtral_AI_Cyber_Q_Vision
|
| 14 |
|
| 15 |
-
<!-- Provide a quick summary of what the model is/does. -->
|
| 16 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 17 |
|
| 18 |
|
| 19 |
-
|
| 20 |
-
|
| 21 |
### Model Description
|
| 22 |
|
| 23 |
-
<!-- Provide a longer summary of what this model is. -->
|
| 24 |
|
| 25 |
-
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 26 |
|
| 27 |
- **Developed by:** [LeroyDyer]
|
| 28 |
- **Model type:** [image-text-to-image-text]
|
|
@@ -32,11 +48,6 @@ This is the model card of a 🤗 transformers model that has been pushed on the
|
|
| 32 |
|
| 33 |
|
| 34 |
|
| 35 |
-
### Recommendations
|
| 36 |
-
|
| 37 |
-
this is an experiment in vision - the model has been created as a mistral/VisionEncoder/Decoder
|
| 38 |
-
Customized from Mixtral_AI_Cyber_Matrix_2.0(7b) & TinyMistral (248)
|
| 39 |
-
ikim-uk-essen/BiomedCLIP_ViT_patch16_224
|
| 40 |
|
| 41 |
## How to Get Started with the Model
|
| 42 |
|
|
|
|
| 12 |
|
| 13 |
# LeroyDyer/Mixtral_AI_Cyber_Q_Vision
|
| 14 |
|
|
|
|
| 15 |
|
| 16 |
+
VisionEncoderDecoderModel is a generic model class that will be instantiated as a transformer architecture
|
| 17 |
+
with one of the base vision model classes of the library as encoder and another one as decoder
|
| 18 |
+
when created with the :
|
| 19 |
+
|
| 20 |
+
```python
|
| 21 |
+
|
| 22 |
+
transformers.AutoModel.from_pretrained class method for the encoder and :
|
| 23 |
+
transformers.AutoModelForCausalLM.from_pretrained class method for the decoder.
|
| 24 |
|
| 25 |
|
| 26 |
+
```
|
| 27 |
+
|
| 28 |
### Model Description
|
| 29 |
|
|
|
|
| 30 |
|
| 31 |
+
|
| 32 |
+
This is the model card of a 🤗 transformers model that has been pushed on the Hub.
|
| 33 |
+
|
| 34 |
+
This is an experiment in vision - the model has been created as a mistral/VisionEncoder/Decoder
|
| 35 |
+
|
| 36 |
+
Customized from
|
| 37 |
+
-Mixtral_AI_Cyber_Matrix_2.0(7b)
|
| 38 |
+
|
| 39 |
+
-TinyMistral (248)
|
| 40 |
+
|
| 41 |
+
-ikim-uk-essen/BiomedCLIP_ViT_patch16_224
|
| 42 |
|
| 43 |
- **Developed by:** [LeroyDyer]
|
| 44 |
- **Model type:** [image-text-to-image-text]
|
|
|
|
| 48 |
|
| 49 |
|
| 50 |
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 51 |
|
| 52 |
## How to Get Started with the Model
|
| 53 |
|