Create README.md

README.md

@@ -0,0 +1,38 @@
+---
+{}
+---
+Note: Those are only the weights for the classifier trained on the `whisper-small` embeddings.
+
+Result of the classifier Rob's human-annotated dataset (`data/voicemail_human_eval.csv`):
+
+Results for chunk size 1 seconds:
+ - Accuracy: 0.8080
+ - Precision: 0.9353
+ - Recall: 0.7692
+ - F1 Score: 0.8442 
+ 
+Results for chunk size 2 seconds:
+ - Accuracy: 0.8560
+ - Precision: 0.9650
+ - Recall: 0.8166
+ - F1 Score: 0.8846 
+ 
+Results for chunk size 5 seconds:
+ - Accuracy: 0.8640
+ - Precision: 0.9856
+ - Recall: 0.8107
+ - F1 Score: 0.8896 
+ 
+Results for chunk size 10 seconds:
+ - Accuracy: 0.8760
+ - Precision: 1.0000
+ - Recall: 0.8166
+ - F1 Score: 0.8990 
+ 
+Saved predictions to one_model/human_eval_results_10s.csv 
+
+Results for full audio samples:
+ - Accuracy: 0.8760
+ - Precision: 1.0000
+ - Recall: 0.8166
+ - F1 Score: 0.8990