gaunernst
/

gemma-3-12b-it-int4-awq

Image-Text-to-Text

text-generation-inference

4-bit precision

Model card Files Files and versions

gemma-3-12b-it-int4-awq / generation_config.json

gaunernst's picture

add model

7f37159 9 months ago

215 Bytes

	{
	"bos_token_id": 2,
	"cache_implementation": "hybrid",
	"do_sample": true,
	"eos_token_id": [
	1,
	106
	],
	"pad_token_id": 0,
	"top_k": 64,
	"top_p": 0.95,
	"transformers_version": "4.50.0.dev0"
	}