• @[email protected]
      link
      fedilink
      English
      31 year ago

      llamacpp. Remember to modify the launch script to use multiple cores. Go to hugging face io and look for GGUF compatible models.