• sunzu
    link
    fedilink
    15 months ago

    ok this is a server. 48gb cards and 67gb ram? for model alone?

    • @[email protected]
      link
      fedilink
      English
      25 months ago

      Each card has 24GB so 48GB vram total. I use ollama it fills whatever vrams is available on both cards and runs the rest on the CPU cores.