• @[email protected]
    link
    fedilink
    English
    2
    edit-2
    5 months ago

    My specs because you asked:

    CPU: Intel(R) Xeon(R) E5-2699 v3 (72) @ 3.60 GHz
    GPU 1: NVIDIA Tesla P40 [Discrete]
    GPU 2: NVIDIA Tesla P40 [Discrete]
    GPU 3: Matrox Electronics Systems Ltd. MGA G200EH
    Memory: 66.75 GiB / 251.75 GiB (27%)
    Swap: 75.50 MiB / 40.00 GiB (0%)
    
    • sunzu
      link
      fedilink
      15 months ago

      ok this is a server. 48gb cards and 67gb ram? for model alone?

      • @[email protected]
        link
        fedilink
        English
        25 months ago

        Each card has 24GB so 48GB vram total. I use ollama it fills whatever vrams is available on both cards and runs the rest on the CPU cores.