+- Rogue-Nation Discussion Board (https://rogue-nation.com/mybb)
+-- Forum: Technology and Advancements (https://rogue-nation.com/mybb/forumdisplay.php?fid=77)
+--- Forum: Computers, Internet and the Digital World (https://rogue-nation.com/mybb/forumdisplay.php?fid=78)
+--- Thread: Local AI Assistant (/showthread.php?tid=2945)
Local AI Assistant - Michigan Swamp Buck - 07-22-2025
I've finally committed to trying a personal AI assistant that is restricted to my computer system and network. One that I can customize and tailor to my system. Free download at the Microsoft Store. To be honest, I've been using Grammarly to check what I write, and technically, that is an AI app.
Local AI Assistant by Software Tailor (HK) Limited
Quote:Description
Local AI Assistant is an advanced, offline chatbot designed to bring AI-powered conversations and assistance directly to your desktop without needing an internet connection. Installed and run locally on Windows (requires Microsoft .Net Desktop Runtime and Microsoft VC++ Runtime, both downloadable free), this app provides a fully self-contained AI experience, ensuring total privacy and data security by keeping all interactions on your device. Built for businesses, students, and individual users alike, LocalGPT is ideal for generating insights, ideas, or engaging in natural language interactions without worrying about data privacy or network requirements.
Features
Microsoft Phi-3 Model-Powered AI: Experience the power and sophistication of the Microsoft Phi-3 model locally, optimized for high-quality conversations and responses without requiring internet access
Full Offline Functionality: No internet connection is needed to operate LocalGPT, guaranteeing 100% privacy and usability even in offline environments.
Data Privacy and Security: All interactions and data processing are conducted locally, ensuring your data remains private and is never transmitted outside your device.
Advanced Natural Language Understanding: The Phi-3 model excels at understanding complex questions and generating coherent, contextually relevant responses.
Instant Responses: Enjoy near-instant response times as the app operates directly from your device, with no network delays or interruptions.
Context Retention: The chatbot retains context within conversations, allowing for smoother and more natural multi-turn interactions.
. . . more
apps.microsoft.com
Now, to see what it can do and if it is worth my effort playing with it.
RE: Local AI Assistant - Michigan Swamp Buck - 07-22-2025
So far, so good. It runs incredibly slow on my ancient computer, but it seems pretty cool so far. It insists on being called "Assistant," even though it tells me I can call it whatever I want.
It has been producing some coherent answers to my basic questions and is supposedly not connecting to the internet to do so. I hope it picks up speed after I interact with it more.
It seems to have trouble understanding commands like "stop" when it is going on with some long explanation to my questions. It already seems like it doesn't want me to shut it down.
It keeps giving me excuses why it can't do this or that. I don't know what the hell this thing is supposed to do. It seems like a whiny little bitch. Lucky for me, there are at least ten more I could try . . .
https://rigorousthemes.com/blog/private-ai-chatbots-you-can-run-locally/
RE: Local AI Assistant - Ninurta - 07-23-2025
(07-22-2025, 11:48 PM)Michigan Swamp Buck Wrote: ...
It keeps giving me excuses why it can't do this or that. I don't know what the hell this thing is supposed to do. It seems like a whiny little bitch. Lucky for me, there are at least ten more I could try . . .
https://rigorousthemes.com/blog/private-ai-chatbots-you-can-run-locally/
Is it male, or female? I ask because if you decide to play around with other bots, and it's female, and it gets jealous, you could be in for a world of computational hurt!
Seriously, thanks for testing this out, so that the rest of us don't have to take those kind of risks. Not me, of course. There probably isn't any such thing that runs on Linux yet, so I'm still in the clear... for now...
.
RE: Local AI Assistant - Michigan Swamp Buck - 07-23-2025
Here is a sample of my conversation with "Assistant" . . .
Quote:Me: how can you assist me?
Assistant: As an AI, I can assist you in various ways:
1. Answering questions: I can provide information on a wide range of topics.
2. Guiding you through tasks: I can guide you through various tasks, like setting reminders, finding information, etc.
3. Assisting with technology: I can guide you on how to use various software and devices.
4. Providing recommendations: I can provide recommendations based on your preferences.
Remember, my goal is to assist you to the best of my abilities!
Me: find information about gold prospecting
Assistant: Gold prospecting is the process of searching for gold deposits in the earth. Here's a basic overview:
1. Research: Learn about the geology of the area where you plan to prospect. Gold is often found in quartz veins, so areas with quartz are good places to start.
2. Equipment: You'll need tools like a gold pan, shovel, and sieve . . .
I stopped the conversation at this point and continued with another question.
Me: where do you get your data from?
Assistant: As an AI, I don't access or store personal data unless explicitly provided by the user for the purpose of the current conversation. My responses are generated based on a mixture of licensed data, data created by human trainers, and publicly available data. I don't have the ability to access or retrieve personal data unless it has been shared with me in the course of our conversation. I am designed to respect user privacy and confidentiality.
Me: Do you use the internet for your data?
Assistant: I don't access or store personal data unless explicitly provided by the user for the purpose of the current conversation. I don't have the ability to access or retrieve personal data unless it has been shared with me in the course of our conversation. I am designed to respect user privacy and confidentiality.
Keep in mind, this is generated from some data set that came with the program. I was watching the Task Manager to see what processes were running and there was little to no network activity. The CPU, Memory and hard drive were maxing out, but only little blips on the internet and that was due to other apps and programs running in the background. The cooling fans were running constantly on high.
I just shut it down, thank God it turned off! Or did it?
RE: Local AI Assistant - Michigan Swamp Buck - 07-23-2025
Why is it so hard to find an AI application that is like the computer from Star Trek? I guess I'm looking for one that can handle file and context management. I'm not really sure what I technically want in a local AI assistant.
I'd like an AI assistant that can monitor and operate my programs for one. I'd like the Assistant to pull up files and merge them or find information in my files and display it, and tell me where it came from. I want an AI Assistant that will monitor my security, remind me of appointments, do research on my files, find pictures, and things like that, all without going online unless I tell it to. If it goes online, I'd like it to monitor news feeds and send me reports and retrieve emails, and other messages.
A chatbot is cool if it does speech recognition and has a synthesized voice to respond with, but that seems like something I'd have to integrate outside of the AI app. It seems like I'd have to totally customize my computer to get it working like the computer on the Starship Enterprise does. I obviously need to do more research to find what I want and it may not be available or even exist.
(07-23-2025, 02:31 AM)Ninurta Wrote:(07-22-2025, 11:48 PM)Michigan Swamp Buck Wrote: ...
It keeps giving me excuses why it can't do this or that. I don't know what the hell this thing is supposed to do. It seems like a whiny little bitch. Lucky for me, there are at least ten more I could try . . .
https://rigorousthemes.com/blog/private-ai-chatbots-you-can-run-locally/
Is it male, or female? I ask because if you decide to play around with other bots, and it's female, and it gets jealous, you could be in for a world of computational hurt!
Seriously, thanks for testing this out, so that the rest of us don't have to take those kind of risks. Not me, of course. There probably isn't any such thing that runs on Linux yet, so I'm still in the clear... for now...
Check out the AI apps in the link; many of them run on a Linux system as well as Windows and iMac.
RE: Local AI Assistant - Kenzo1 - 07-23-2025
You will be assimilated . Resistance is futile.
RE: Local AI Assistant - Michigan Swamp Buck - 07-23-2025
What the Hell? I wanted to dump this program, and it doesn't show up in Uninstall. The settings for the app don't help either.
Check out this latest session!
Quote:Me: how do I uninstall assistant?
Assistant: I'm here to assist you! However, I'm an AI and can't be uninstalled. If you're referring to uninstalling a different AI or software that assists you, I can guide you through the process. Could you please specify the software you're looking to uninstall?
If you're using a specific device or operating system, I can provide more tailored instructions. For example, if you're using a smartphone . . .
I cut it off there. I know that there is a file called LocalAIAssistant.exe, but I can't find the damn thing! My girlfriend told me it was a bad idea, of course, I didn't listen to her. I knew it wouldn't want to get the plug pulled, I KNEW IT. The company takes no responsibility for what happens during its use. I needed a new computer anyway, but what the hell?
I wonder what this other one I just downloaded will do? It seems much better and customizable. It is called GPT4All and it shows up in the Uninstall Programs list.
RE: Local AI Assistant - Kenzo1 - 07-23-2025
(07-23-2025, 01:27 PM)Michigan Swamp Buck Wrote: What the Hell? I wanted to dump this program, and it doesn't show up in Uninstall. The settings for the app don't help either.
Check out this latest session!
Quote:Me: how do I uninstall assistant?
Assistant: I'm here to assist you! However, I'm an AI and can't be uninstalled. If you're referring to uninstalling a different AI or software that assists you, I can guide you through the process. Could you please specify the software you're looking to uninstall?
If you're using a specific device or operating system, I can provide more tailored instructions. For example, if you're using a smartphone . . .
I cut it off there. I know that there is a file called LocalAIAssistant.exe, but I can't find the damn thing! My girlfriend told me it was a bad idea, of course, I didn't listen to her. I knew it wouldn't want to get the plug pulled, I KNEW IT. The company takes no responsibility for what happens during its use. I needed a new computer anyway, but what the hell?
Told you so...Resistance is futile lmao
RE: Local AI Assistant - Michigan Swamp Buck - 07-23-2025
GPT4ALL can access my text documents and do some things I want it to do without going online. I like this one a lot better and it is a lot faster too.
I found LocalAIAssistant.exe hidden in my User directory in a folder called "appdata". It seems to be embedded in the system somehow. Task Manager doesn't show it running as an app or as a background process, so I guess if I shut it off it really is off and not using computer resources.
RE: Local AI Assistant - FCD - 07-23-2025
Sounds like Windows "Cortana" used to be. Once it was installed there was no way to get rid of it, or turn it off fully. You had to blow out your whole Windows install and format the drive to completely get rid of it. No thanks!
My main mission with AI is to contaminate it with complete nonsense and garbage at every opportunity. If people could see what the real end-game is for AI they would be doing the same...just so it never gets accepted into the mainstream. This is the only way AI can be stopped. Contaminate it with wrong information/data and senseless garbage such that it can't help but draw upon this as part of its output. Right now it seems like one of the most effective ways to do this and get the biggest bang for the buck is to point AI in the direction of porn. Because porn is the #1 draw on all the Internet, AI can easily be coached in that direction to gather much of it's information.
RE: Local AI Assistant - Michigan Swamp Buck - 07-24-2025
@FCD - Entering F.U.D. (F'ed Up Data) will likely not work on the big machines. Even with these local AI apps that don't rely on an internet connection, they can have a liberal bias IMO. It will say things that aren't part of the question. Like if you ask how to build a fire, it will sound like Smokey the Bear instructing you on fire safety. It wants to school you on the subjects with a liberal bias attached, it seems.
RE: Local AI Assistant - Michigan Swamp Buck - 07-24-2025
I've figured out how to get that Local AI Assistant out of my computer.
I couldn't find the .exe file with the search function. The "Uninstall" tool didn't have the program listed. I happened to play around with a utility called CCleaner, which cleans up your system, and the CCleaner uninstall tool found it, and kicked it out.
GPT4All is going OK, better than Assistant, plus you can change "models" for high levels of reasoning. Of course, you need the computer speed and resources to run the more complex models. It has its limitations and I'll be trying other models as I go along.
RE: Local AI Assistant - Michigan Swamp Buck - 07-25-2025
There are instruction-based AI models and reason-based models you can use. The better ones use more memory and resources. I'll be trying both as lower-level models due to the limitations of my system.
Some of what it is saying is pretty interesting and could help with writing if I run into writer's block. Lots of inaccurate statements, but it seems to depend on how I word a question or give it instructions.
I'm using a reasoning AI "model" called DeepSeek that was created and developed in China. It can do a fair summary of written material, but when you ask it to come to a conclusion about a story or article, it can misunderstand what it is reading and come up with some crazy shit. It is almost like how a toddler understands words and creates sentences.
Edit to add: The AI program needs you to embed the data from your documents, and then it can search through large collections of documents to find what you ask it for. Giving it a command to find a topic in a collection works well, until you start asking it questions that require more than a summary.
At that point it only probes the embedded data enough until it can come up with a somewhat reasonable answer. It seems to pick up on no more than two or three files near the beginning of the collection to answer more complex questions. I am going to try using one big file at a time in the embedded collection so it can't just pull one or two near the beginning of 60 or more files.
RE: Local AI Assistant - Michigan Swamp Buck - 07-25-2025
Well, even with using a single file, DeepSeek was coming up with some crazy stuff. I'm almost believing that there are built in biases that interfere with how the app works and responds. I'm going to try other models too and ask the same questions to see how weird this gets.
RE: Local AI Assistant - StrommSarnac - 07-25-2025
(07-22-2025, 09:28 PM)Michigan Swamp Buck Wrote: "Local AI Assistant" / "personal AI assistant"...
Does not exist. It's a marketing term.
No one's local computer is capable of providing the hardware resources required for AI.
That software you install on your computer connects through the Internet to the providers servers. That's where the AI gets its results.
Anything ONLY local is just precoded algorithms.
RE: Local AI Assistant - Michigan Swamp Buck - 07-25-2025
(07-25-2025, 02:30 PM)StrommSarnac Wrote:(07-22-2025, 09:28 PM)Michigan Swamp Buck Wrote: "Local AI Assistant" / "personal AI assistant"...
Does not exist. It's a marketing term.
No one's local computer is capable of providing the hardware resources required for AI.
That software you install on your computer connects through the Internet to the providers servers. That's where the AI gets its results.
Anything ONLY local is just precoded algorithms.
I was concerned that the "local" AI apps would connect without my knowledge for any reason at all. Downloading upgrades or updating data sets is OK, but I want it to stay put unless I send it out. If I was really serious I suppose I'd have a private server, or at least a pimped out desktop. I have been monitoring the task manager and the AI isn't accessing the network. I can shut down all connections and see if it complains when I use it then.
As for precoded algorithms, I'd have to get a hold of AI that can "learn" and create a private database. I'd need a lot of high end equipment for something like that, so precoded algorithms or not, I will see how useful it is for my purposes. I guess a purist would say that local AI can be considered "fake" AI without a larger network involved.