Yeah, I agree 24B-36B sizes are better in general. I don't have unified RAM tho ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

senko 17 days ago | parent | context | favorite | on: Gemma 4 12B: A unified, encoder-free multimodal mo...

Yeah, I agree 24B-36B sizes are better in general.

I don't have unified RAM tho and offloading to CPU is dog slow, which is why I'm interested in 7b-12b models.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact