what quantization did u try ? u can use Q4 quantization, im pretty sure that 48G... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		yassa9 8 days ago \| parent \| context \| favorite \| on: Gemma 4 12B: A unified, encoder-free multimodal mo... what quantization did u try ? u can use Q4 quantization, im pretty sure that 48GB would be enough
		help

sgt101 7 days ago [–]

8bits is fine.... I was talking full bore.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact