Hacker News
new
|
past
|
comments
|
ask
|
show
|
jobs
|
submit
login
adastra22
7 months ago
|
parent
|
context
|
favorite
| on:
Show HN: WebGPU enables local LLM in the browser –...
Any computer with a display has a GPU.
om8
7 months ago
[–]
Sure, but integrated graphics usually lacks vram for LLM inference.
adastra22
7 months ago
|
parent
[–]
Which means that inference would be approximately the same speed (but compute offloaded) as the suggested CPU inference engine.
Guidelines
|
FAQ
|
Lists
|
API
|
Security
|
Legal
|
Apply to YC
|
Contact
Search: