msg Local AI: Chat

msg Local AI: Chat is an application to locally run Large Language Model (LLM) based generative Artificial Intelligence (AI) characters (aka "chatbots").

It is based on the freely available Faraday LLM host application, four pre-installed Open Source Mistral 7B LLMs, and 24 pre-configured Faraday AI characters.

Each Faraday AI character combines a pre-selected LLM (fine-tuned for instruct or chat use), pre-configured LLM parameters, and a corresponding pre-selected LLM.

msg Local AI: Chat ships as a setup program for the Windows operation system which installs the Faraday LLM host application, the Mistral 7B LLMs and pre-configures Faraday for the provided AI characters. Download
msg Local AI: Chat
Setup (0.9.3)

The msg Local AI: Chat setup program does not require administrator privileges during installation. Everything is installed into %localappdata% and %appdata% only. A simple click on the desktop icon "Uninstall msg Local AI Chat" will also uninstall it at any time again.

Notice on USAGE STATISTICS: msg Local AI: Chat uses the Faraday LLM host application. Faraday sends anonymous usage information to its vendor. msg Research explicitly checked this communication in 2024/02 and considered it harmless from a GDPR point of view, as no personal information were contained in the sent data.

Notice on CLOUD ACCOUNT: msg Local AI: Chat uses the Faraday LLM host application. Faraday provides the possibility to create an account in the Cloud on faraday.dev, login to it from within the application, and use this account to upload and share chats and AI characters via the Cloud. For the intended use of msg Local AI: Chat, none of this functionality is required or even recommended by msg Research. msg Local AI: Chat is intended to be used with the pre-defined AI characters only. The user is in charge when using the additional functionality of Faraday.

Notice on CONTENT: msg Local AI: Chat uses uncensored LLMs which were trained by Mistral AI with huge amounts of unknown, publicly available data from the Internet. Hence, the AI character's responses contain all types of public information and in an entirely unfiltered format. The user is responsible for treating the responses with great care, validating them, and especially always considering and evaluating the responses in the context of the current law and social morality.

Notice on INTENDED USE-CASES: msg Local AI: Chat provides 22 AI characters for the primary non-dialog-based use-cases. In addition, 2 general-purpose AI characters are provided (explicitly tagged as "GP") for the secondary dialog-based use-cases. The latter AI characters are provided with the intention of learning Prompt Engineering only. Please do not consider them as true alternatives to powerful general-purpose chatbots like OpenAI ChatGPT.

Notice on RESPONSE QUALITY: msg Local AI: Chat is based on the decent but rather small Open-Source LLM Mistral 7B to run even on computers with very constrained RAM and CPU resources. As a consequence, the overall response quality obviously is noticeably reduced in contrast to state-of-the-art chatbots, like the commercial GPT-3.5/GPT-4-based OpenAI ChatGPT.

msg Local AI: Chat is intended both as a learning application for Generative AI Prompt Engineering and as a production application for leveraging from generic text-based generative AI use-cases under full offline-first and GDPR-compliance aspects.

During installation, the installer will download between 4GB and 16GB of LLM data from the HuggingFace portal, depending on the particular features you selected during installation.

NOTICE: Please be patient; the download will require many minutes, depending on how Internet connectivity. In case it breaks because of timeouts, just repeat the step.

After installation, you will find an icon named "msg Local AI Chat" on your desktop to run the Faraday LLM host application. After a short opt-in dialog of the Faraday vendor, you can select the particular AI character.

You have 24 pre-defined AI characters available. Each AI character has a name based on its use-case, and the language it speaks below its name. Click on the AI character to open a dialog with it.

All AI characters not tagged with "GP" (general purpose) are instruct-based and primed to a particular use-case through a pre-configured system prompt (which can be found on the right sidebar under "Scenario").

Do not chat with those instruct-based AI characters by asking questions. Instead, enter the request directly. For instance, for the Translator (EN-DE) AI character, directly enter your English text to be translated to German.

Only the two "GP" (general purpose) AI characters named "Assistant" are chat-based and hence accept full question/answer dialog sessions. But beware of the above notice: Mistral 7B is an excellent small LLM but cannot fully compete with ChatCPT, of course!

NOTICE: just be patient on your initial request after entering an AI character, as the underlying LLM first has to be loaded into memory by Faraday.

COPYRIGHT & LICENSES

CREDITS & THANKS

Many thanks to Ahoy Labs, Inc. for their awesome Faraday LLM host application and to Mistral AI for their excellent Mistral 7B LLM. Your work allows others to leverage useful AI aspects without large constraints.