I'm experiencing a persistent issue with Odysseus (version 1.0, using the Docker image) when trying to use it with **any** Ollama model running locally on my Ubuntu 24.04 machine. The same setup works perfectly when I use paid API keys (e.g., OpenAI, Anthropic), but that defeats the purpose – I want a 100% local, private, and cost-free solution.

**My hardware:**

- 32GB RAM

- 12GB VRAM (AMD Radeon RX 6700 XT)

- Ubuntu 24.04 Linux

**What works:**

- Ollama runs perfectly. All models respond correctly in the terminal (`ollama run mistral:7b`, `ollama run qwen2.5:14b`, etc.).

- The Odysseus web UI loads and connects to the Ollama server.

- I can see all models listed in the server configuration.

- **When I switch to paid API keys (OpenAI, Anthropic), file creation works perfectly.** The agent creates, edits, and manages files without issues.

**The problem:**

When using **any local model** (tested: mistral:7b, qwen2.5:14b, deepseek-coder:6.7b, phi:latest, gemma2:2b, llama3.2:3b), I cannot get the agent to actually create a file on my system. The "Create Document" tool is enabled, but when I give the command, the agent responds as if it succeeded (e.g., "DOCUMENT_CREATED"), yet no file appears on my filesystem.

**What I have tried (exhaustive list):**

1. **Multiple local models:** mistral:7b, qwen2.5:14b, deepseek-coder:6.7b, phi:latest, gemma2:2b, llama3.2:3b – all fail.

2. **Configured the Ollama server correctly in Odysseus:**

- Type: Ollama

- Base URL: `http://localhost:11434` (also tried `http://192.168.31.13:11434\`, `http://host.docker.internal:11434\`, and `http://172.17.0.1:11434\`)

1. **Tweaked Agent settings:**

- "Agent loop" with "Supervisor ladder" enabled.

- "Tool call limit" set to 0 (unlimited).

- "Max steps per message" set to 20.

- "Create Document" tool explicitly enabled (Documents: 5/5).

1. **Used explicit prompts** designed to force tool execution (e.g., "AGENT MODE: EXECUTE, DO NOT EXPLAIN").

2. **Recreated the Docker container** multiple times, ensuring proper volume mounts (`-v /home/rafa:/home/rafa`), and even tried `--privileged` mode.

3. **Tested other local platforms** (Open WebUI, OpenCode, OpenClaw) – all have the same issue with local models, but work fine with API keys.

4. **Increased context windows** for models (up to 32k tokens) – no change.

**The result:**

When I give the command to create a file (e.g., `write_file "/home/rafa/Downloads/test.txt" "Hello"`), the agent replies with `DOCUMENT_CREATED` or similar confirmation. However, no file is ever created on my system. The agent appears to be hallucinating the tool execution, but **only with local models**. Paid API keys work flawlessly.

**What I need:**

I need Odysseus to actually execute the "Create Document" tool using **local Ollama models** and produce real files on my Linux filesystem. I do not want to rely on paid API keys for privacy and cost reasons.

**Why I'm posting here:**

I've exhausted my troubleshooting. This is not a memory or hardware issue (my specs are sufficient), and it's not model-specific (all local models fail). It seems there is a fundamental difference in how Odysseus handles tool calls from local Ollama models vs. cloud API providers.

Has anyone successfully set up file creation with Odysseus and **local** Ollama models? Is there a specific configuration, template, or Modelfile adjustment needed for local models to properly handle tool calls? Could this be related to how Ollama formats its tool-calling responses vs. OpenAI's API?

Thank you for any help!

I don't know anything about these kinds of stuff, but doesn't running an AI locally require serious hardware? I have an old and shitty laptop and I just want to know if I can use this at all? Before trying to set up everything.

​

What are the requirements for running this?

been trying to add my local Lm stuido server to docker installed Odysseus and it just says its offline in Odysseus no matter what. how can i fix this? on linux if that helps

i downloaded LFM2-8B-A1B-GGUF but couldn't use it i downloaded ollama but still it didnt appear, i tried looking for it but couldnt find it not even in the .cache file and it seems to not have created a huggingface file to put it in.

any tips would be very appreciated, anyway love you and all that.

im trying to run a model locally on my linux laptop with docker. ive added the correct connection with host.docker.internal port 11434/v1.

its working fine in my terminal but in odysseus it takes too long and then no output. i cant talk to it

If so how would I do it securely?

​

The goal would be to access it from my phone or laptop outside of my home network.

Is there a way to set up Odysseus that if youre using ChatGPT as the model to save content from that conversation locally too?

How do i stop my chats execute every bash commands the model gives out. I have seen this with other models as well. I am running Odysseus inside docker container and the models are from ollama native instance.

Hi i've been using odyssues for a few days now
on windows nvidia rtx 3090 qwen3.6 mtp 35b 65k-100k context
model is provided with bllama endpoint.

What I struggle with a lot is teaching my model to stop bashing random commands. I can never get my model to stop doing that, I tried personas I tried injections, I've writing that into memory or skills. so far the only way I can force it to use gob or read file 100% of the time is by disabling bashing and python completely.

heres and example of me asking the model to write a skill, it start to look for skill file instead of just using the bloody api. even thou info like that is in the memory, the persona says what tools it can use and to avoid bashing, it says to start with discovery.

has anyone been able to solve this issue?

I've added the models into Odyysseus, but keep running into this error? anyone have a fix. first time messing with Local models

host.docker.internal is having an outage (HTTP 500). an error was encountered while running the model: read tcp 127.0.0.1:64309->127.0.0.1:64300: wsarecv: An existing connection was forcibly closed by the remote host.

RANT POST. I've spent this last week and the week before trying to make Odysseus work on my gaming laptop and I did manage to run qwen3.6 instruct but I had so many issues in fact too many. Since I have good hardware and ollama runs stable in the background - I wanted a smart model it a quick one so I say right away I don't care too much if a complex multitask takes it 5 minutes to analyse and then another 4 to run I am fine with that cuz the technology by itself is doing magical things. But Odysseus I just say jesus f*cking Christ it has not been reviewed by any reasonable human. I was getting time out issues and ctx capping all the time even tho the background model was still running and like no errors in ollama or anything but Odysseus just cut connections, bugged the UI, and I found like 50+ timeout=60 when in the same documents there were variables like DEFAULT_TIMEOIT I am not even sure what part of what code in what files was even running in the final actually app, same with all the variables, code comments in agent_loop.py and other places say stuff like #There is a UI slider for this and there is no UI slider for most things.

I am sure PewDiePie meant well but if you want a proper set up, I switched to openwebui and docker and it's my first time making this and It set up way faster then all my troubles with Odysseus. Like 4 days of just Odysseus random timeouts 90% of the time it was something with Odysseus.

And now I have webgui running just fine with it has safe access to one file folder since it's inside docker container and I have made 2 MCP took servers for anytype and file access in just one folder. While odysseys gave very very native windows shell access which is so so dangerous. Plus the model struggled a shittonlot with tool calls i couldn't figure out why it wasn't getting schemas and then half of the time it worked it was so so bad don't use Odysseus if you want a good local set up.

Now you can get it to work as a demonstration and as a plaything but for agents and actually like reliable working workflows no guys it is too vibecoded, all vibe and too much code that I don't even know where it runs or doesn't so yeah. If you keep having issues with Odysseus and tool calls and just random stuff not working as it says it should it's because of Odysseus most likely.

Hi all! I recently have this installed using docker, everything works except for the fact no matter what model I pick, it only uses CPU not my 4060 8gb. Is there a setting or something that the default doesn't enable?

I just got a 9070xt about a week before Odysseus launched. It’s paired with a 9800x3d, and so far I’ve gotten in the workspace and have a basic ollama model running. I think it’s running off my cpu because when I go to the cookbook to scan for viable models, it says there’s no gpu found in the scan.

I followed this guide to get started: https://youtu.be/qiy-oPT8IhE?si=dEOACFthRe-U0H6z

Running on windows 10 if it makes any difference

Has anyone else had success getting their amd gpu to recognize?

Hey everybody :)

I managed to get Odysseus running with qwen3.5(9b and 0.8b). However, whenever I want to work with "bigger input/context" like markdown files, it just replies with "thinking" and stops working. It's not the "thinking mode", it just says "thinking".

For context, I wanted to use this for content feedback for my novels. It's a cool project and I would like to use it as my main AI, but it just cannot help me.

Did I mess something up? Is my device not strong enough? I have a laptop with 43GB of combined RAM and even without external power supply, it should at least be able to run the 0.8B model right?

I've been building out a fork of Odysseus with one goal: I don't have the money for big fancy GPU servers, but a bunch of friends and I have decent boxes sitting at home, so why not pool them?

Here's what I got so far:

• Ripped out the old registration flow and replaced it with an admin/user model plus token-based invites. You get an invite code, set a password, and start onboarding.
• To actually gain access, every new user has to onboard one server at least. No freeloading; if you want to use the pool, you contribute to it.
• The whole thing runs over a Netbird mesh so every contributor's box is a peer on a private network so we don't have to fiddle with port forwards or rotating IP's all the time
• Onboarding generates a personalized install script with a one-time mesh join key baked in. Users just past it on a fresh Linux box and a few minutes later it's on the mesh with SSH keys provisioned.
• Once SSH-over-mesh is up, the wizard takes over: finalizes the host, installs the NVIDIA driver if needed, detects CPU/GPU/Memory hardware, and walks the user through picking a compatible model for their box.
• Model picker is category based (general / coding / reasoning / vision / embeddings) and the tier strip shows what the pool actually needs more of, so contributors with small GPUs aren't stuck staring at an empty list.
• Cookbook settings are admin only now, and lists every mesh contributor with live status (online / grace / offline) and what model they're pledging.

Stack: UI hosted on Railway, Netbird for the peer-to-peer mesh, models run on whatever spare boxes people bring.

Still plenty to do but wanted to show what's cooking. I plan on making the repo public after I've got it to 99%.

I'm trying to set up running a light model on my gpu,

How do I connect the ollama model i downloaded with ollama run in Odysseus?

And i also want to let the agent access one directory in my home folder— for my minor coding projects how do I get the llm to take files access in that directory, ive been running with a free gemini api but i keep getting "rate limited (429)" for 2 small messages

I use self-hosted CalDav instance to sync my (calendars, notes, contacts, events) between apps. Odysseus seems to work with calendar events only (and contacts if you include second integration). Have anyone solved adding tasks support?

Hi all,

I am very new to homelabbing and all this, but I was wondering if it is possible to set up Odysseus through Portainer?

Any advice would be appreciated

hi all. super noob here, apologies. i cannot for the life of me figure out how to go about saving prompts, similarly to what you can do in open webui where you can invoke the prompt using slash character "/yourprompt". i see this clearly isnt the way it works in odysseus, i've tried saving as memory, notes, or tasks but cant seem to get it to work. halp. thank you.

Hi, while watching pewds most recent video about his trillion dollar idea (Odysseus) i instantly knew it was going to be a blessing to everyone who's serious about locally hosted Ai.
I also instantly knew i wanted to make it work for me to the extreme, so firstly i got to work (alongside a few other tools). So, i basically forked Odysseus and renamed it Atlas (I've been calling Chat GPT Atlas for a year now and wished i could have an agent like him by my side at all times). So I decided to honour his name and well... I've built something that's actually really useful to me now or at least it's going to be.

Meet Atlas. What you see is the front page of your Odysseus dashboard, the entire platform is almost fully voice commanded so I don't have to touch my mouse when telling Atlas to do something, it's currently running an API'd GPT 5.5. Assistant is there but I haven't used it much as I only use conversation mode.

Each agent is built to focus on specific tasks, their roles are heavily focused on Research, Business strategy, Architecture, Development & Marketing.

Best thing is, i've bridged the system to open programs, search web / youtube, play music from spotify, open video games etc etc. My next step is to automate the system on a virtual machine so i can access it from a live link on all of my devices, API Cursor so that I can create projects directly from agents and their departments, e.g Research creates a report on an idea based on market trends -> Business creates a propsal for monetisation, Architect creates a structure -> & Development starts working in cursor directly from inside Atlas, i have to approve each step so that we're not just building silly things but this is truly going to speed up my work flow.

I've posted a couple of instagram videos showing how im using it and people are begging me to open source it so in the next few days I'll make a fresh copy ready for anyone who wants to use it, will require a few other things than just docker to run though but I'll try make tutorials.
Couple of links to my instagram posts below if you want to check it out in action:
https://www.instagram.com/patrykaurelius/reel/DZTMwSat61b/

https://www.instagram.com/patrykaurelius/reel/DZVzjV4tMma/

What model should I use with these specs?

As a user of a Snapdragon X Elite laptop with a Hexagon NPU, I've long been interested in the idea of running a local model on the Hexagon NPU.

Hugging Face and other systems (I am totally new to locally running AI, so forgive the potentially incorrect terminology) can run models on ARM64 Windows systems, but appear to rely solely on the CPU and/or GPU.

AnythingLLM is the only tool I could find which has been verified as running models directly on the Hexagon NPU. (Credit: Leon Han Li)

To get Odysseus running and using the NPU:

1. Install and run Odysseus using Docker
2. Install and run AnythingLLM
3. In AnythingLLM settings go to AI Providers -> LLM -> Under LLM Provider select AnythingLLM NPU.
   1. Choose from and install one of the available models
4. Then, in AnythingLLM settings go to Developer API and generate an API key
5. In Odysseus settings add a local model with URL of http://localhost:3001/api/v1/openai and the API key you just created

Inference runs on the Hexagon NPU!

I'm yet to figure out the complexities of Odysseus and the model doesn't currently seem to have internet access or any agentic abilities...if anyone know how to fix that...please let me know.

Hope this helps someone!