@[email protected] to [email protected]English • 4 months agoThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.comexternal-linkmessage-square61fedilinkarrow-up1214
arrow-up1214external-linkThe first GPT-4-class AI model anyone can download has arrived: Llama 405Barstechnica.com@[email protected] to [email protected]English • 4 months agomessage-square61fedilink
minus-squaresunzulinkfedilink1•4 months agook this is a server. 48gb cards and 67gb ram? for model alone?
minus-square@[email protected]linkfedilinkEnglish2•4 months agoEach card has 24GB so 48GB vram total. I use ollama it fills whatever vrams is available on both cards and runs the rest on the CPU cores.
ok this is a server. 48gb cards and 67gb ram? for model alone?
Each card has 24GB so 48GB vram total. I use ollama it fills whatever vrams is available on both cards and runs the rest on the CPU cores.