Update README.md
Browse filesdocs: adding README and some information about model
README.md
CHANGED
|
@@ -1,3 +1,88 @@
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 3 |
---
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
---
|
| 2 |
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- ru
|
| 5 |
+
metrics:
|
| 6 |
+
- accuracy
|
| 7 |
+
base_model:
|
| 8 |
+
- ai-forever/ruRoberta-large
|
| 9 |
+
pipeline_tag: text-classification
|
| 10 |
+
tags:
|
| 11 |
+
- reviews
|
| 12 |
+
- e-commercy
|
| 13 |
+
- foodtech
|
| 14 |
---
|
| 15 |
+
# Food Delivery Feedback Multi-Label Classification Model
|
| 16 |
+
|
| 17 |
+
This model was developed for multi-label classification of customer feedback in the food delivery domain. It can identify up to 50 different aspects/issues from user reviews and feedback messages.
|
| 18 |
+
|
| 19 |
+
## Model Description
|
| 20 |
+
|
| 21 |
+
The model is designed to analyze customer feedback and automatically categorize it into multiple relevant labels, helping businesses quickly identify and address various aspects of their food delivery service.
|
| 22 |
+
|
| 23 |
+
### Key Features:
|
| 24 |
+
- Multi-label classification across 50 distinct categories
|
| 25 |
+
- Specialized for food delivery domain feedback
|
| 26 |
+
- Handles various aspects including delivery speed, food quality, packaging, customer service, etc.
|
| 27 |
+
- Supports Russian language feedback processing
|
| 28 |
+
|
| 29 |
+
### Use Cases:
|
| 30 |
+
- Automated feedback categorization
|
| 31 |
+
- Customer satisfaction analysis
|
| 32 |
+
- Service quality monitoring
|
| 33 |
+
- Issue identification and prioritization
|
| 34 |
+
- Operational improvement insights
|
| 35 |
+
|
| 36 |
+
### Performance:
|
| 37 |
+
- Trained on about 3000 customer feedback messages
|
| 38 |
+
- Achieves **Full Match Accuracy** on test set
|
| 39 |
+
- Optimized for real-world food delivery feedback scenarios
|
| 40 |
+
|
| 41 |
+
## Evaluation Metric: Full Match Accuracy
|
| 42 |
+
|
| 43 |
+
The model is evaluated using a strict full match accuracy metric that requires exact matching between predicted and target labels.
|
| 44 |
+
|
| 45 |
+
### Metric Description:
|
| 46 |
+
- Type: Exact Match / Perfect Match Accuracy
|
| 47 |
+
- Range: 0 to 1 (or 0% to 100%)
|
| 48 |
+
- Format: Labels are represented as space-separated indices (e.g., "0 1 10")
|
| 49 |
+
|
| 50 |
+
### Example:
|
| 51 |
+
```python
|
| 52 |
+
# Correct prediction (100% accuracy):
|
| 53 |
+
Target: "0 1 10"
|
| 54 |
+
Prediction: "0 1 10"
|
| 55 |
+
|
| 56 |
+
# Incorrect predictions (0% accuracy):
|
| 57 |
+
Target: "0 1 10"
|
| 58 |
+
Prediction: "0 1" # Partial match is considered incorrect
|
| 59 |
+
Target: "0 1 10"
|
| 60 |
+
Prediction: "0 1 10 2" # Extra label is considered incorrect
|
| 61 |
+
```
|
| 62 |
+
|
| 63 |
+
### Labels Include:
|
| 64 |
+
- Delivery time issues
|
| 65 |
+
- Food quality concerns
|
| 66 |
+
- Order accuracy
|
| 67 |
+
- Packaging condition
|
| 68 |
+
- Courier behavior
|
| 69 |
+
- App/website functionality
|
| 70 |
+
- Payment issues
|
| 71 |
+
|
| 72 |
+
## Usage
|
| 73 |
+
|
| 74 |
+
The model can be used for:
|
| 75 |
+
- Real-time feedback classification
|
| 76 |
+
- Batch processing of historical feedback
|
| 77 |
+
- Customer support automation
|
| 78 |
+
- Service quality analytics
|
| 79 |
+
|
| 80 |
+
## Training
|
| 81 |
+
|
| 82 |
+
The model was trained as part of an NLP competition focused on improving customer feedback analysis in the food delivery industry. It uses state-of-the-art transformer architecture optimized for multi-label classification tasks.
|
| 83 |
+
|
| 84 |
+
## Limitations
|
| 85 |
+
|
| 86 |
+
- Primarily optimized for Russian language feedback
|
| 87 |
+
- May require fine-tuning for specific regional contexts
|
| 88 |
+
- Best suited for food delivery domain specifically
|