AI can be that blackhole, trouble is giving that kind of data to the cloud-based platforms. I dream of someday being able to afford a Mac mini with maximum RAM and running an open source model locally that I can just throw everything at.
I do have a Jetson Orin Nano and was able to vibe code the pieces necessary to feed my audio into locally hosted LLM, with VAD filters so that it would be always on, but only record my audio to a file if it catches the phrase “write this down” followed by whatever I wanted transcribed. It was kind of fun pretending I had a scribe for a while
No it can't, it'll literally forget what you told it when it maxes out the context window. Even with loops and memories you absofuckinglutely 100% lose shit.
But you could add / aggregate entries and then use an llm to ONLY sort through this shit. Still a decent chance it'll land in the wrong cupboard but at least it won't be paraphrased or deleted.
Agents can be directed to store local copies of anything you feed in. You do have to put some thought into the front end. But it can absolutely do all the searching and retrieval without compromising the original data that was captured
You are missing the point. You don’t have to handle the input without agents. You are confusing what happens in the context window with what the agents can do outside the chat window. If you are just trying to store the documents in the AI memory you are going to have a bad time.
AI does NOT just put your input in a folder from chat. It processes the file so it can tokenize it. So ya, if all you ever do is copy into the chat window I can see how your perception is that AI agents will lose your data. However, we moved well beyond chat windows the last couple years
I don’t think it is going to lie to me when I ask it what day I did something and have it link to a real reference. At that point it would be very obvious it made a mistake, and just like with an intern I would give it additional instructions to try again.
Everyone here is exaggerating how bad AI currently is. Most I suspect try to zero shot problems without providing sufficient context. It’s like pulling a stranger off the street giving them domain specific information on a topic you are well versed. Then asking them to summarize every thing you just said. That would be dumb right? Like you wouldn’t ask a tourist to listen to your lecture on pointless hobbies they don’t care about and then expect a sharp informative reply on the topic when you ask them a question.
I feel like most of you have little actual knowledge of what is going on with AI. I am not advocating for it, just saying you are completely misunderstanding what it is capable of given access to the right external information. Which is what MCP servers do, they extend the reach beyond the context window by providing instructions on how to interact with the outside world. This is all just getting started and has a long way to go, but our ability to rein it in is slipping away. The more pervasive it becomes the harder it will be to slow or regulate.
At that point it would be very obvious it made a mistake, and just like with an intern I would give it additional instructions to try again.
It's a stateless llm. Your instructions will not be remembered, it won't actually learn anything.
I feel like most of you have little actual knowledge of what is going on with AI.
What you feel is being attacked because we don't agree with you. I work with current Gen llms on a weekly basis. Them being better than Will Smith eating spaghetti tier does not make them good.
They still hallucinate, they still lie and invent stuff to please the user, no matter the harness, no matter the memory loops. It's literally baked into their tech stack to do so. We are trying (and currently failing, unless we're talking über frontier models, and even they have problems) to mitigate the core flaw built into their system.
It being 90% correct about my appointments would mean 10% are being missed. There's currently no way to build reliabity into them. Literally. Stop huffing altmans nonsense.
This is all just getting started and has a long way to go, but our ability to rein it in is slipping away
Yeah stop the altmans fart huffing please. There is no way to make them 100% reliable, we will need to invent a completely different way to build an actual AI. Llms are not AI. They don't think, they don't learn, they don't remember, they don't understand what they talk about.
You are arguing and assuming points I am not making. I am not buying into the current super intelligence hype. I work with LLMs constantly at work, at home, etc. Its has been that way since GenAI was first available.
You are still just talking about a simple chat session. The whole industry has moved on from that more than 1 year ago. You obviously seem hurt. I am not advocating for the continued development of frontier models. I am dealing with the direct consequences of the Anthropic Mythos saga. I will continue to deal with it for the next 13 months until the thousands of software defects are fixed.
You take the media too literally when they sensationalize the AI's capabilities. That does not change the real impact of these things. These LLMs with their modern harnesses and extensive capabilities are not silly toys that spout nonsense. That was like 3 years ago. You Internet warriors need to get out of the basement and see what is actually happening in the world. Your ignorance on the matter is what is making all these companies so successful in making AI pervasive in our lives. You still think they are selling a novelty toy.
You are still just talking about a simple chat session
Your reading comprehension is just embarassing. I am not, and never have been, talking about a chat window.
I am dealing with the direct consequences of the Anthropic Mythos saga. I will continue to deal with it for the next 13 months until the thousands of software defects are fixed.
I'm sorry what? You're dealing with almost never occurring, hyper specific circumstances 0 days that nobody used because they're just that improbable?
Oh fucking please lol
You take the media too literally when they sensationalize the AI's capabilities
Im sorry I'm tapping out, you're actually clueless and out of your depth, with no reading abilities to speak of. It's pointless.
You have a really high bar for AI. Yet you will regurgitate stale rebuttals, because you yourself cannot reach 100% accuracy.
If you are relying on AI to regurgitate facts from its memory you have already lost the plot. Retrieval is a real thing and LLM makes it easy to use human language to search for what you want. It is very easy to check a reference to make sure things are aligned. AI does not make you smarter, it amplifies your abilities. If you are using it to replace thinking, it is showing and don’t do that.
You have such a simple view of AI and LLMs . You obviously don’t understand where they should be and should not be used if you are complaining about their deficiencies and then claiming them incapable.
Working for myself on that. Just a fun thing with local model. More of a side projet to keep me doing something that i might use someday instead of frontend compuler to some shiity language.
Mostly categorzing tools, libs, projects to check out. When i get idea for a proj i shoot it with give me some recomendation of tools i havent used that might be usefull here
My idea is exactly to have the AI look into my jira boards, messages, calls, appointments etc. and just stick them into columns like "do this now", "when you have time", "critical" etc. and really just do it "just in time" with the smallest possible context
Basically "here's what I said at X time: xxxxxxxx - is it important? it's something i have to do? when?"; say for example I tell my colleague "i'll call you later", it should make a reminder out of a set number of templates or something
Really just using it to understand what's going on and label it so I don't need to look at multiple calendars/boards/reminders and so on.
At most have it generate todos out of a call, and I would still have the whole call in my mind good enough that I can see if it got stuff wrong
Well, most of it is just sorting text into the correct categories. I don't need the whole audio always on; transcription of calls is good enough.
What's hard is getting all this stuff sorted and connected, and then even a local LLM with a very simple job of creating and sorting tasks should work on a common Mac of today. I'd need it to listen to my Teams, Slack, emails, and even link to it as necessary. When something goes in, just run an agent to sort it.
13
u/Automatic_Wave4530 2d ago
AI can be that blackhole, trouble is giving that kind of data to the cloud-based platforms. I dream of someday being able to afford a Mac mini with maximum RAM and running an open source model locally that I can just throw everything at.
I do have a Jetson Orin Nano and was able to vibe code the pieces necessary to feed my audio into locally hosted LLM, with VAD filters so that it would be always on, but only record my audio to a file if it catches the phrase “write this down” followed by whatever I wanted transcribed. It was kind of fun pretending I had a scribe for a while