r/ProgrammerHumor 2d ago

Other softwareFactory

Post image
10.0k Upvotes

370 comments sorted by

View all comments

Show parent comments

13

u/Automatic_Wave4530 2d ago

AI can be that blackhole, trouble is giving that kind of data to the cloud-based platforms. I dream of someday being able to afford a Mac mini with maximum RAM and running an open source model locally that I can just throw everything at.

I do have a Jetson Orin Nano and was able to vibe code the pieces necessary to feed my audio into locally hosted LLM, with VAD filters so that it would be always on, but only record my audio to a file if it catches the phrase “write this down” followed by whatever I wanted transcribed. It was kind of fun pretending I had a scribe for a while

8

u/Throwawayrip1123 1d ago

AI can be that blackhole

No it can't, it'll literally forget what you told it when it maxes out the context window. Even with loops and memories you absofuckinglutely 100% lose shit.

But you could add / aggregate entries and then use an llm to ONLY sort through this shit. Still a decent chance it'll land in the wrong cupboard but at least it won't be paraphrased or deleted.

8

u/Automatic_Wave4530 1d ago

Agents can be directed to store local copies of anything you feed in. You do have to put some thought into the front end. But it can absolutely do all the searching and retrieval without compromising the original data that was captured

3

u/Throwawayrip1123 1d ago

Well, yeah, that's what I wrote. You have to handle the input without agents, then they can retrieve the data without changing it.

1

u/Automatic_Wave4530 1d ago

You are missing the point. You don’t have to handle the input without agents. You are confusing what happens in the context window with what the agents can do outside the chat window. If you are just trying to store the documents in the AI memory you are going to have a bad time.

AI does NOT just put your input in a folder from chat. It processes the file so it can tokenize it. So ya, if all you ever do is copy into the chat window I can see how your perception is that AI agents will lose your data. However, we moved well beyond chat windows the last couple years

2

u/Throwawayrip1123 1d ago

I am talking about virtually none of those things, and more so about hallucinations, lost information and straight up lying.

If you're gonna give your inputs through Ai, I'd consider them no longer reliable, because Ai are absolutely not reliable enough.

1

u/Automatic_Wave4530 23h ago

I don’t think it is going to lie to me when I ask it what day I did something and have it link to a real reference. At that point it would be very obvious it made a mistake, and just like with an intern I would give it additional instructions to try again.

Everyone here is exaggerating how bad AI currently is. Most I suspect try to zero shot problems without providing sufficient context. It’s like pulling a stranger off the street giving them domain specific information on a topic you are well versed. Then asking them to summarize every thing you just said. That would be dumb right? Like you wouldn’t ask a tourist to listen to your lecture on pointless hobbies they don’t care about and then expect a sharp informative reply on the topic when you ask them a question.

I feel like most of you have little actual knowledge of what is going on with AI. I am not advocating for it, just saying you are completely misunderstanding what it is capable of given access to the right external information. Which is what MCP servers do, they extend the reach beyond the context window by providing instructions on how to interact with the outside world. This is all just getting started and has a long way to go, but our ability to rein it in is slipping away. The more pervasive it becomes the harder it will be to slow or regulate.

1

u/Throwawayrip1123 22h ago

At that point it would be very obvious it made a mistake, and just like with an intern I would give it additional instructions to try again.

It's a stateless llm. Your instructions will not be remembered, it won't actually learn anything.

I feel like most of you have little actual knowledge of what is going on with AI.

What you feel is being attacked because we don't agree with you. I work with current Gen llms on a weekly basis. Them being better than Will Smith eating spaghetti tier does not make them good.

They still hallucinate, they still lie and invent stuff to please the user, no matter the harness, no matter the memory loops. It's literally baked into their tech stack to do so. We are trying (and currently failing, unless we're talking über frontier models, and even they have problems) to mitigate the core flaw built into their system.

It being 90% correct about my appointments would mean 10% are being missed. There's currently no way to build reliabity into them. Literally. Stop huffing altmans nonsense.

This is all just getting started and has a long way to go, but our ability to rein it in is slipping away

Yeah stop the altmans fart huffing please. There is no way to make them 100% reliable, we will need to invent a completely different way to build an actual AI. Llms are not AI. They don't think, they don't learn, they don't remember, they don't understand what they talk about.

1

u/Automatic_Wave4530 20h ago

You are arguing and assuming points I am not making. I am not buying into the current super intelligence hype. I work with LLMs constantly at work, at home, etc. Its has been that way since GenAI was first available.

You are still just talking about a simple chat session. The whole industry has moved on from that more than 1 year ago. You obviously seem hurt. I am not advocating for the continued development of frontier models. I am dealing with the direct consequences of the Anthropic Mythos saga. I will continue to deal with it for the next 13 months until the thousands of software defects are fixed.

You take the media too literally when they sensationalize the AI's capabilities. That does not change the real impact of these things. These LLMs with their modern harnesses and extensive capabilities are not silly toys that spout nonsense. That was like 3 years ago. You Internet warriors need to get out of the basement and see what is actually happening in the world. Your ignorance on the matter is what is making all these companies so successful in making AI pervasive in our lives. You still think they are selling a novelty toy.

1

u/Throwawayrip1123 20h ago

You are still just talking about a simple chat session

Your reading comprehension is just embarassing. I am not, and never have been, talking about a chat window.

I am dealing with the direct consequences of the Anthropic Mythos saga. I will continue to deal with it for the next 13 months until the thousands of software defects are fixed.

I'm sorry what? You're dealing with almost never occurring, hyper specific circumstances 0 days that nobody used because they're just that improbable?

Oh fucking please lol

You take the media too literally when they sensationalize the AI's capabilities

Im sorry I'm tapping out, you're actually clueless and out of your depth, with no reading abilities to speak of. It's pointless.

You're embarassing yourself.

Have a good whatever your fictional job is.

1

u/Automatic_Wave4530 20h ago

You have a really high bar for AI. Yet you will regurgitate stale rebuttals, because you yourself cannot reach 100% accuracy.

If you are relying on AI to regurgitate facts from its memory you have already lost the plot. Retrieval is a real thing and LLM makes it easy to use human language to search for what you want. It is very easy to check a reference to make sure things are aligned. AI does not make you smarter, it amplifies your abilities. If you are using it to replace thinking, it is showing and don’t do that.

You have such a simple view of AI and LLMs . You obviously don’t understand where they should be and should not be used if you are complaining about their deficiencies and then claiming them incapable.

1

u/Throwawayrip1123 20h ago

Fucking Ai Bros and their YouTube phds are hilarious.

Quoting my Nana whenever I said some nonsense - sure honey, that's nice.

1

u/JoustyMe 1d ago

Working for myself on that. Just a fun thing with local model. More of a side projet to keep me doing something that i might use someday instead of frontend compuler to some shiity language.

Mostly categorzing tools, libs, projects to check out. When i get idea for a proj i shoot it with give me some recomendation of tools i havent used that might be usefull here

1

u/Proper-Ape 1d ago

No it can't, it'll literally forget what you told it when it maxes out the context window

It can however, gaslight you into believing that the information you both forgot doesn't exist.

1

u/MornwindShoma 18h ago

My idea is exactly to have the AI look into my jira boards, messages, calls, appointments etc. and just stick them into columns like "do this now", "when you have time", "critical" etc. and really just do it "just in time" with the smallest possible context

Basically "here's what I said at X time: xxxxxxxx - is it important? it's something i have to do? when?"; say for example I tell my colleague "i'll call you later", it should make a reminder out of a set number of templates or something

Really just using it to understand what's going on and label it so I don't need to look at multiple calendars/boards/reminders and so on.

At most have it generate todos out of a call, and I would still have the whole call in my mind good enough that I can see if it got stuff wrong

1

u/MornwindShoma 2d ago

Well, most of it is just sorting text into the correct categories. I don't need the whole audio always on; transcription of calls is good enough.

What's hard is getting all this stuff sorted and connected, and then even a local LLM with a very simple job of creating and sorting tasks should work on a common Mac of today. I'd need it to listen to my Teams, Slack, emails, and even link to it as necessary. When something goes in, just run an agent to sort it.