tinwhiskers@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 3 years agoNew technique to run 70B LLM Inference on a single 4GB GPUai.gopubby.comexternal-linkmessage-square0linkfedilinkarrow-up11arrow-down10
arrow-up11arrow-down1external-linkNew technique to run 70B LLM Inference on a single 4GB GPUai.gopubby.comtinwhiskers@lemmy.world to Free Open-Source Artificial Intelligence@lemmy.worldEnglish · 3 years agomessage-square0linkfedilink
