• RandomLegend [He/Him]
    link
    fedilink
    English
    14
    edit-2
    5 months ago

    It’s available through ollama already. i am running the 8b model on my little server with it’s 3070 as of right now.

    It’s really impressive for a 8b model

      • RandomLegend [He/Him]
        link
        fedilink
        English
        15 months ago

        Yup, 8GB card

        Its my old one from the gaming PC after switching to AMD.

        It now serves as my little AI hub and whisper server for home assistant

        • @[email protected]
          link
          fedilink
          English
          15 months ago

          What the heck is whisper? Ive been fooling around with hass for ages, haven’t heard of it even after at least two minutes of searching. Is it openai affiliated hardwae?