zhenbo_endle@lemmy.caM to TIL about Computer Science@lemmy.caEnglish · 3 months agoRunning Local LLMs, CPU vs. GPU - a Quick Speed Testdev.toexternal-linkmessage-square1fedilinkarrow-up17arrow-down12file-text
arrow-up15arrow-down1external-linkRunning Local LLMs, CPU vs. GPU - a Quick Speed Testdev.tozhenbo_endle@lemmy.caM to TIL about Computer Science@lemmy.caEnglish · 3 months agomessage-square1fedilinkfile-text
minus-squareALERT@sh.itjust.workslinkfedilinkEnglisharrow-up2·3 months agotl;dr CPU is slow, GPU is faster
tl;dr CPU is slow, GPU is faster