metanovus commited on
Commit
8cb804a
·
verified ·
1 Parent(s): 498e9c4

Update README.md

Browse files

docs: adding README and some information about model

Files changed (1) hide show
  1. README.md +85 -0
README.md CHANGED
@@ -1,3 +1,88 @@
1
  ---
2
  license: apache-2.0
 
 
 
 
 
 
 
 
 
 
 
3
  ---
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
  license: apache-2.0
3
+ language:
4
+ - ru
5
+ metrics:
6
+ - accuracy
7
+ base_model:
8
+ - ai-forever/ruRoberta-large
9
+ pipeline_tag: text-classification
10
+ tags:
11
+ - reviews
12
+ - e-commercy
13
+ - foodtech
14
  ---
15
+ # Food Delivery Feedback Multi-Label Classification Model
16
+
17
+ This model was developed for multi-label classification of customer feedback in the food delivery domain. It can identify up to 50 different aspects/issues from user reviews and feedback messages.
18
+
19
+ ## Model Description
20
+
21
+ The model is designed to analyze customer feedback and automatically categorize it into multiple relevant labels, helping businesses quickly identify and address various aspects of their food delivery service.
22
+
23
+ ### Key Features:
24
+ - Multi-label classification across 50 distinct categories
25
+ - Specialized for food delivery domain feedback
26
+ - Handles various aspects including delivery speed, food quality, packaging, customer service, etc.
27
+ - Supports Russian language feedback processing
28
+
29
+ ### Use Cases:
30
+ - Automated feedback categorization
31
+ - Customer satisfaction analysis
32
+ - Service quality monitoring
33
+ - Issue identification and prioritization
34
+ - Operational improvement insights
35
+
36
+ ### Performance:
37
+ - Trained on about 3000 customer feedback messages
38
+ - Achieves **Full Match Accuracy** on test set
39
+ - Optimized for real-world food delivery feedback scenarios
40
+
41
+ ## Evaluation Metric: Full Match Accuracy
42
+
43
+ The model is evaluated using a strict full match accuracy metric that requires exact matching between predicted and target labels.
44
+
45
+ ### Metric Description:
46
+ - Type: Exact Match / Perfect Match Accuracy
47
+ - Range: 0 to 1 (or 0% to 100%)
48
+ - Format: Labels are represented as space-separated indices (e.g., "0 1 10")
49
+
50
+ ### Example:
51
+ ```python
52
+ # Correct prediction (100% accuracy):
53
+ Target: "0 1 10"
54
+ Prediction: "0 1 10"
55
+
56
+ # Incorrect predictions (0% accuracy):
57
+ Target: "0 1 10"
58
+ Prediction: "0 1" # Partial match is considered incorrect
59
+ Target: "0 1 10"
60
+ Prediction: "0 1 10 2" # Extra label is considered incorrect
61
+ ```
62
+
63
+ ### Labels Include:
64
+ - Delivery time issues
65
+ - Food quality concerns
66
+ - Order accuracy
67
+ - Packaging condition
68
+ - Courier behavior
69
+ - App/website functionality
70
+ - Payment issues
71
+
72
+ ## Usage
73
+
74
+ The model can be used for:
75
+ - Real-time feedback classification
76
+ - Batch processing of historical feedback
77
+ - Customer support automation
78
+ - Service quality analytics
79
+
80
+ ## Training
81
+
82
+ The model was trained as part of an NLP competition focused on improving customer feedback analysis in the food delivery industry. It uses state-of-the-art transformer architecture optimized for multi-label classification tasks.
83
+
84
+ ## Limitations
85
+
86
+ - Primarily optimized for Russian language feedback
87
+ - May require fine-tuning for specific regional contexts
88
+ - Best suited for food delivery domain specifically