Update README
Browse files- .gitattributes +2 -0
- README.md +47 -0
- res/YOLO_accuracy.png +3 -0
- res/bb_1.jpeg +3 -0
- res/bb_2.jpeg +3 -0
    	
        .gitattributes
    CHANGED
    
    | @@ -33,3 +33,5 @@ saved_model/**/* filter=lfs diff=lfs merge=lfs -text | |
| 33 | 
             
            *.zip filter=lfs diff=lfs merge=lfs -text
         | 
| 34 | 
             
            *.zst filter=lfs diff=lfs merge=lfs -text
         | 
| 35 | 
             
            *tfevents* filter=lfs diff=lfs merge=lfs -text
         | 
|  | |
|  | 
|  | |
| 33 | 
             
            *.zip filter=lfs diff=lfs merge=lfs -text
         | 
| 34 | 
             
            *.zst filter=lfs diff=lfs merge=lfs -text
         | 
| 35 | 
             
            *tfevents* filter=lfs diff=lfs merge=lfs -text
         | 
| 36 | 
            +
            *.png filter=lfs diff=lfs merge=lfs -text
         | 
| 37 | 
            +
            *.jpeg filter=lfs diff=lfs merge=lfs -text
         | 
    	
        README.md
    CHANGED
    
    | @@ -1,3 +1,50 @@ | |
| 1 | 
             
            ---
         | 
| 2 | 
             
            license: gpl-3.0
         | 
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
| 3 | 
             
            ---
         | 
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | |
|  | 
|  | |
| 1 | 
             
            ---
         | 
| 2 | 
             
            license: gpl-3.0
         | 
| 3 | 
            +
            tags:
         | 
| 4 | 
            +
            - ultralytics
         | 
| 5 | 
            +
            - yolo
         | 
| 6 | 
            +
            - object-detection
         | 
| 7 | 
            +
            - ui-detection
         | 
| 8 | 
            +
            - computer-vision
         | 
| 9 | 
            +
            - agent
         | 
| 10 | 
             
            ---
         | 
| 11 | 
            +
             | 
| 12 | 
            +
            # deki-yolo: Mobile UI Element Detection Model
         | 
| 13 | 
            +
             | 
| 14 | 
            +
            This is a YOLO model trained to identify common UI elements in mobile
         | 
| 15 | 
            +
            screenshots. It is the core detection model for the [deki huggingface space](https://huggingface.co/spaces/orasul/deki) 
         | 
| 16 | 
            +
            or [deki github](https://github.com/RasulOs/deki)
         | 
| 17 | 
            +
             | 
| 18 | 
            +
            ## Model Description
         | 
| 19 | 
            +
             | 
| 20 | 
            +
            The model is trained to detect the following four classes of UI elements:
         | 
| 21 | 
            +
            *   `View`: General-purpose containers.
         | 
| 22 | 
            +
            *   `ImageView`: Icons and images.
         | 
| 23 | 
            +
            *   `Text`: Text elements.
         | 
| 24 | 
            +
            *   `Line`: Separators and lines.
         | 
| 25 | 
            +
             | 
| 26 | 
            +
            This model can be used as a foundational component for applications that need
         | 
| 27 | 
            +
            to understand screen layouts, such as AI agents for mobile automation,
         | 
| 28 | 
            +
            accessibility tools, and UI code generation.
         | 
| 29 | 
            +
             | 
| 30 | 
            +
            ---
         | 
| 31 | 
            +
             | 
| 32 | 
            +
            ## YOLO examples
         | 
| 33 | 
            +
             | 
| 34 | 
            +
            Bounding boxes with classes for bb_1:
         | 
| 35 | 
            +
             | 
| 36 | 
            +
            <img src="./res/bb_1_yolo.jpeg" alt="example1" width="60%">
         | 
| 37 | 
            +
             | 
| 38 | 
            +
            Bounding boxes with classes for bb_2:
         | 
| 39 | 
            +
             | 
| 40 | 
            +
            <img src="./res/bb_2_yolo.jpeg" alt="example2" width="60%">
         | 
| 41 | 
            +
             | 
| 42 | 
            +
            ---
         | 
| 43 | 
            +
             | 
| 44 | 
            +
            ## YOLO model accuracy
         | 
| 45 | 
            +
             | 
| 46 | 
            +
            The model was trained on 486 images and was tested on 60 images.
         | 
| 47 | 
            +
             | 
| 48 | 
            +
            Current YOLO model accuracy:
         | 
| 49 | 
            +
            
         | 
| 50 | 
            +
             | 
    	
        res/YOLO_accuracy.png
    ADDED
    
    |   | 
| Git LFS Details
 | 
    	
        res/bb_1.jpeg
    ADDED
    
    |   | 
| Git LFS Details
 | 
    	
        res/bb_2.jpeg
    ADDED
    
    |   | 
| Git LFS Details
 | 
