Good but rambles on and on
#12
by
lexthoms411
- opened
I dont know if it is my settings but this model in two or three separate applications will provide me what I ask, but then rambles on and even starts to hallucinate a lot. It will essentially not stop for a long time. Does anyone have any suggestions?
Hey, it's probably due to incorrect generation parameters. You can try playing the parameters based on the recommended Llama 3.1's configuration and perhaps increase the repetition_penalty if you can still see this behavior.