chobeat@lemmy.ml to Technology@lemmy.worldEnglish · 2 months agoMeet the AI workers who tell their friends and family to stay away from AIwww.theguardian.comexternal-linkmessage-square38fedilinkarrow-up1280arrow-down18
arrow-up1272arrow-down1external-linkMeet the AI workers who tell their friends and family to stay away from AIwww.theguardian.comchobeat@lemmy.ml to Technology@lemmy.worldEnglish · 2 months agomessage-square38fedilink
minus-squarebrucethemoose@lemmy.worldlinkfedilinkEnglisharrow-up3·edit-22 months agoBloefz has a great setup. Used Mi50s are cheap. An RTX 3090 + a cheap HEDT/Server CPU is another popular homelab config. Newer models run reasonably quickly on them, with the attention/dense layers on the GPU and sparse parts on the CPU.
Bloefz has a great setup. Used Mi50s are cheap.
An RTX 3090 + a cheap HEDT/Server CPU is another popular homelab config. Newer models run reasonably quickly on them, with the attention/dense layers on the GPU and sparse parts on the CPU.