• kent_eh@lemmy.ca
        link
        fedilink
        English
        arrow-up
        4
        ·
        13 days ago

        My biggest issue with that is the amount of bloat a full local LLM implementation would add.

        But if it’s an optional module that you can choose to add (or choose not to add) after the fact, I have no complaint.

      • Mwa@lemm.ee
        link
        fedilink
        English
        arrow-up
        2
        arrow-down
        1
        ·
        13 days ago

        Ohh I assume it’s mistral cause Llama uses a incompatible License.