GitHub

Like grep but for natural language questions. Based on Mistral 7B or Mixtral 8x7B.

If nvidia driver that supports cuda 12.1 exists, it installs cuda version, else cpu version. Replace small with large to install Mixtral 8x7B. It's ~7GB or ~48GB.