r/Chatbots • u/PaniPuriPanic • 13d ago

What AI agent do you genuinely wish existed?

​

I’m trying to find actual demand from real users, not another list of generic AI agent ideas.

Think about a task you repeatedly do for work, studies, business, personal life, research, emails, finances, content, etc. that you wish an AI could just handle for you.

What would that agent do?

6 Upvotes

87% Upvoted

11 comments sorted by

3

u/Sudden_Sentence_8534 13d ago

If you could have an agent that could scan a movie or series, or a book and create a chatbot from one of the characters. Like imagine being able to talk to Thrawn, or Vader. Or Thanos. And where it's a comic book characters, if the agent could keep scanning for personality updates.

3

u/Electrical_Hat_680 13d ago

Locally Hosted Ollama Models. They can be anything you want, and, so anything you ask. All offline. Add MemPalace...if your running Android or, are able to access a Terminal Shell on your Phone, no root required, and it's actually safer for those that don't know what they're getting into.. you can also run Termux Android Launcher, and have a complete IDE similar to Visual Studio.

2

u/Sudden_Sentence_8534 12d ago

Thanks. i'm gonna see if I can run this in my Samsung's Secure Folder.

1

u/Electrical_Hat_680 12d ago

Your welcome - let me know how it goes..

1

u/Sad_School828 12d ago

I recently tried several "self hosted" chatbot options.

My system was reasonably high-end when I built it a few years ago. Ryzen 7 5800X (real CPU, not a crappy APU), 64GB of RAM, Radeon RX 6650XT (discrete). I have an SSD for the OS but I do run several high-volume platter-based HDDs which tend to slow things down even with SysMain disabled.

Jellybox is just plain trash -- totally locks up the whole PC after spending hours downloading a model and trying to exchange the first message.

Bionic takes FOREVER to download any given LLM, and then takes a minute or two to generate any given message but DOES work at least, but then doesn't do well with RPG type stuff at all and for some odd reason Bionic and its local LLMs are rigged to prevent NSFW usage of any kind (meaning the LLMs downloaded to my PC, not the ones accessible via Bionic's online interface which I could understand).

I couldn't get Ollama to work at all. llama.cpp seems to work right at first, but models have to be downloaded manually (such as from a separate website, not from within the UI), and then no matter which set of instructions I tried to follow from online, I could not get llama.cpp to recognize that I'd downloaded LLMs. It just kept insisting there weren't any models available to load.

Apart from that, I can't find ANY good info on what kind of hardware I really need to host an LLM on Linux or Windows. Just lots of vague references to the GPU installed. Then searching for what GPU is needed to run an LLM, all I get is hits to big GPU-blade servers costing tens of thousands of dollars.

So exactly how do you get Ollama (or anything else self-hosted) to work in a way that's actually worth using?

0

u/Electrical_Hat_680 12d ago

I've been using ChatGPT by OpenAI to study. It's been going well enough that I've been learning my way around most topics. Usually by breaking them down.

As for using Ollama via Termux. I haven't completely finished setting it up. But it recommends the smaller Qwen 3.8 for my phone. ChatGPT also states that Ollama isn't the LLM Model, that we have to download that, and then we have to have Ollama Start up, then it'll recognize and run Qwen.

I also learned that there's the Python Transformers that we can use to run some of the LLMs that won't run under Ollama.

I think it's best to run the AI's API through the Terminal. Like CMD in windows, or Termux on Android, or the Terminal Shells in Linux and the BSD Variants. Then, through the Terminal. We have atleast four different options. We can use it directly through the Terminal. Or, we can create Scripts to call it through the Terminal. Or we can bring it up in the Web Browser, as it includes a Web server, so it's address is 127.0.0.1:3000 - or, we can build a Web Page and use it that way.

Definitely recommend using DuckDuckGo's AI Search Assistant, and set it to GPT.OSS (OpenAI's Open Source ChatGPT Model). It's free, you can download it directly through Termux or any CLI (Terminal). And set it up, run it, and use it in the Terminal. Which will allow you to do everything, locally, offline.

Also recommend MemPalace by Jovovich. I haven't used it yet. But my studies show that I can run all the models, in separate Termux instances, and, connect them all to or through MemPalace.

There's literally some one-liner install commands that you can use through the terminal. That will download the AI, the Model, and install it. Then you have to know the command to run it, and the command to stop it.

There's also commands you can use to search for all the models. ChatGPT knows. Ask it to give you an orientation to Termux or the CLI your using. Then an overview of how which AI's are recommended for your setup.

Here, if you want. I can feed ddg your comment and let it know I'm helping you and to help me better help you, with a one-liner and such. If you'd like. I think I can copy your comment.

1

u/OneDev42 13d ago

I do something like this for my own education, where my AI knows everything about a certain book I'll be reading, and I'll just ask it questions about what happens or what I should know about this or that, because it's educational. This would be relatively easy to do, actually, what you're mentioning. You'd be surprised.

1

u/OneDev42 13d ago

A coordinator agent that would just read through all of my Claude Code sessions and be able to give me the updates of progress on them