Does anyone know if GPU passthrough is available in any kind of macOS guests? I ... | Hacker News

Hacker Newsnew | past | comments | ask | show | jobs | submit

		cjbprime on Jan 19, 2024 \| parent \| context \| favorite \| on: Tart: VMs on macOS using Apple's native Virtualiza... Does anyone know if GPU passthrough is available in any kind of macOS guests? I was hoping to run fast LLM inference in containers or virt guests.

fkorotkov on Jan 19, 2024 [–]

There is a paravirtualized GPU available to macOS hosts. But it’s a bit limited and might not work for LLMs but worth trying since it might work.

Guidelines | FAQ | Lists | API | Security | Legal | Apply to YC | Contact