Update README.md

README.md

@@ -21,17 +21,6 @@ tags:
 KStack-full models is a collection of fine-tuned open-source generative text models fine-tuned on KStack dataset with rule-based filtering. 
 This is a repository for fine-tuned CodeLlama-7b model in the Hugging Face Transformers format.
 
-## Rule-based filtering
-To increase the quality of the dataset and filter out statistical outliers such as homework assignments, we filter out the dataset entries according to the following rules:
-* We filter out files which belong to the low-popular repos (the sum of stars and forks is less than 6)
-* Next, we filter out files which belong to the repos with less than 5 Kotlin files
-* Finally, we remove files which have less than 20 SLOC
-
-We clean the content of the remaining dataset entries according to the following rules:
-* We remove all non-ASCII entries
-* We remove all package lines such as _package kotlinx.coroutines.channels_
-* We remove half of the import lines.
-
 # Model use
 
 ```python
@@ -83,10 +72,17 @@ The model was trained on one A100 GPU with following hyperparameters:
 
 More details about finetuning can be found in the technical report
 
-# Fine-tuning data
+# Data filtering
 
-For this model we used 15K exmaples of Kotlin Exercices dataset {TODO: link!}. Every example follows HumanEval like format. In total dataset contains about 3.5M tokens. 
-For more information about the dataset follow the link.
+To increase the quality of the dataset and filter out statistical outliers such as homework assignments, we filter out the dataset entries according to the following rules:
+* We filter out files which belong to the low-popular repos (the sum of stars and forks is less than 6)
+* Next, we filter out files which belong to the repos with less than 5 Kotlin files
+* Finally, we remove files which have less than 20 SLOC
+
+We clean the content of the remaining dataset entries according to the following rules:
+* We remove all non-ASCII entries
+* We remove all package lines such as _package kotlinx.coroutines.channels_
+* We remove half of the import lines.
 
 # Evaluation