  Breast Ultrasound plays a vital role in cancer diagnosis as a non-invasive
approach with cost-effective. In recent years, with the development of deep
learning, many CNN-based approaches have been widely researched in both tumor
localization and cancer classification tasks. Even though previous single
models achieved great performance in both tasks, these methods have some
limitations in inference time, GPU requirement, and separate fine-tuning for
each model. In this study, we aim to redesign and build end-to-end multi-task
architecture to conduct both segmentation and classification. With our proposed
approach, we achieved outstanding performance and time efficiency, with 79.8%
and 86.4% in DeepLabV3+ architecture in the segmentation task.
