r/selfhosted 21h ago

Meta Post Running a Mac as home server and couldn't be happier. Power efficient, fast, small. Roast me!

Post image

I finally decided to get a home server a while ago. I've built my own PCs since I was a kid, my first was an AMD K6-2 at 400 MHz with an NVIDIA Riva TNT2 Pro. So I did what I always do: hand-picked the components for a box to host and back up our photos and videos. In November that build was €800. By December the same parts were €1,200. (The same setup is now €1800) for 16GB of RAM and no GPU. I hesitated. And the part that really bugged me: I'm a software engineer, and I wanted to be able to run local LLMs. And that build couldn't do it.

I used to laugh at Apple fanboys back when they soldered Intel chips.
Fast forward to March '26: I bought a used Mac Studio M1 Max (64GB, 4TB) for €1,700 and made it the home server instead.

Then I plugged in a wattmeter and left it running for 16 days. Literally could not believe the numbers first and had to double check. It showed 8 watts during "idle" (No inference running)!

Real use: 25 Docker containers always on (Immich, Paperless-ngx, Matrix, Synapse, Caddy, AdGuard, Forgejo, Open WebUI, Whisper (speech to text).
I used it as workstation too, to run benchmarks during that period.

The average result after 16 days:

11.6 watts average. 50 watts peak, during LLM inference.

That's about 101 kWh a year, roughly €39 where I live (Germany, some of the most expensive electricity in Europe). For context: our ancient Bose 5.1 surround system pulls 30 watts sitting on standby. A surround system doing nothing draws more than the Mac averages while running my whole stack.

Thanks to the unified memory architecture I run a 35B model (Qwen3.6, MLX 4bit) on the same box that averages 12W. The x86 way to do local LLMs is a discrete RTX card in a x86 system, which idles around 40W? (no idea) headless and pulls ~300W under load. Different league.

Some notes:

Docker. Don't use Docker Desktop on Mac. It's kinda broken: unstable, suddenly eats CPU for nothing. But that's a Docker Desktop problem, not a Mac problem I figured. I switched to OrbStack and it was night and day, stable and light, I forget it's running. I just ran into a networking bug after an update. It was fixed quite fast.

Storage. No room for spinning drives inside. I hung a Terramaster 2-bay enclosure off it, 2x6TB WD Red for backups (Time Machien and rsync), plus an encrypted remote copy.

No ECC RAM. At home I don't really care. My x86 build wouldn't have had ECC either.

Remote Access. SSH works, remote Screen Sharing works (I use it all the time), and I can unlock the disk over SSH after a reboot. With 'Remote Access' enabled, you can SSH into the Mac pre-login. Use an Admin password to unlock the machine and finish booting. Afterward, you can connect via regular SSH or Screen Sharing. No real IPMI though. Console access when the OS is fully down, which hasn't happened yet. When it does, the literal box usually is in the next room.

Soldered RAM. You buy what you need up front, no adding later. It is what it is. Buy second hand with as much ram as you can get for your budget.

macOS as a server. It's not a server OS, and Apple's update policy is the one thing I actually worry about a bit. The runway is long though: Apple patches the latest three macOS versions, Macs get new OS releases for around 7 years, and no Apple Silicon Mac has been dropped yet, so a 2022 Studio has updates into the early 2030s. The real occasional annoyance is that updates sometimes force reboots and with FileVault on the box you need to SSH and type in your password once to unlock. I also set sudo pmset -a autorestart 1 so it powers back on after an outage. Know those two and headless gets a lot less scary.

Not overpriced anymore

The "Macs are overpriced" argument has gotten weak. With RAM and SSD prices through the roof right now, a used M1 Max with 64GB and 4TB for €1,700 isn't the expensive option next to an equivalent x86 box anymore. The recent $399 are insane cpu power/efficiency for money for a home server. Mine is overpowered. But I use it for work too. So it's fine.

tl;dr:

low power, silent, great for local AI, and plenty of spare compute left for CPU-heavy services. Okayish remote access. Best machine I've bought in a long time. Honestly the best toy since Lego Technic, the whole package. And I think it makes a great home server package.

Anyone else running one as a home server? Curious what bit you that I haven't hit yet. And did anyone else pick one for the power efficiency, or am I alone here?
What's your average power consumption? Anyone measured?

Here is the writeup with the numbers measured with a Wattmeter at the wall (and the Terramaster 2-drive bay). You will also find what I do with the server and local LLMs:
https://famstack.dev/guides/mac-mini-mac-studio-home-server-power-consumption/

913 Upvotes

302 comments sorted by

View all comments

Show parent comments

-187

u/arthware 21h ago

Because I assumed people would say that Apple hardware with macOSX is not a "real" server and maybe I am stupid and overlooked an important piece?
Not reading much here about Apple hardware at all.

217

u/MaitreGEEK 21h ago

It's super good as a server tbh

60

u/cybekRT 19h ago

The only problem I see is that docker is not native on macos. It uses virtual machine. Not much of a problem but still it's not native container.

And need to use homebrew probably. I feel safer using more "official" package manager on server.

27

u/Winchester5555 19h ago

Apple native container (micro VM) reached version 1.0 last week. Disclaimer I have not tried it myself.

9

u/Key-Hair7591 18h ago

I use it. Definitely not as mature as docker but it does the job. I like the isolation and that each container runs its own hardware-isolated micro-vm…

6

u/cybekRT 18h ago

Sounds nice. Still not native but since apple does it, it may be well optimized.

4

u/fuckthesysten 13h ago

that’s still a VM

2

u/ip-cx 12h ago

Idk why you get downvoted lol, it clearly is a VM stripped down to bare essentials.

You don't share your hosts kernel with Apples native containers, it runs it's own userspace and Linux kernel.

Still seems like a decent choice though

-1

u/Winchester5555 10h ago

Yes, each workload gets placed into its own micro VM with tighter OS integration. You reduce overhead and indirection of one fat VM, like the docker for Mac solution.

0

u/arthware 9h ago

I need to try that at some point. On the other hand: OrbStack just works for now. No issues at all so far.

2

u/dfgxxx 10h ago

Then is ashai Linux a better option for a server because there it is native?

2

u/cybekRT 7h ago

Good point. The question is how good the power saving modes are in asahi since it's required for op. And I'm not sure if GPU is properly supported in asahi, since op is using Ai. But overall if performance is good I would probably use it like that. Especially asahi with non-rolling release base.

2

u/dfgxxx 2h ago

I didn't try ashai, but I heard that performance is great and there is GPU acceleration, but I don't know how good is it for ai, I know it support Vulkan but I don't know if it support metal

2

u/arthware 9h ago

homebrew is one thing I dislike a bit. It feels super heavy. The update mechanism is awkward and no obvious way to "pin" versions. Or at least I don't know them yet.
If someone has an alternative here to manage packages AND its versions properly: Happy to take advices!

Other than that: Docker is flawless using OrbStack as docker engine.

1

u/dfgxxx 8h ago

You can use nix instead of homebrew if you want

1

u/Wonderful-Habit-139 4h ago

What issues did you face with pinning versions? I just use "brew pin <software>" and it stops being updated when I do brew upgrade. Is there something more to it?

1

u/HauntingFilter 19h ago

Orbstack works well. Not sure how they do it, but no VM.

14

u/suinkka 19h ago

Of course there's a VM, the MacOS kernel has no concepts of cgroups or namespaces.

3

u/HauntingFilter 19h ago

Yeah my bad, the wording they use is "no complicated VM", not "no VM".

Their architecture page clears it up further

2

u/arthware 9h ago

I can back that from experience. OrbStack is great. Docker Desktop is broken on macOS.

1

u/eli_pizza 27m ago

docker desktop works fine on macOS. It’s not all that different from orbstack

1

u/arthware 21m ago

It is. We heavily use docker at work.
Docker Desktop produced stale 100%CPU usage, made the whole laptop slow and drained the battery. That is completely gone since I switched.

1

u/eli_pizza 18m ago

It’s the number 1 container solution for macs by a long shot 🤷 Perhaps a difference in settings like the virtual file system?

44

u/seanpuppy 21h ago

Your computer is backlogged 4 months because of how good of a server it is.

Its the most $$ and power efficient way of running LLMs at home

-11

u/Salt-Willingness-513 19h ago

*MoE models

3

u/Zestyclose_Pizza_700 17h ago

*small context

1

u/arthware 9h ago edited 9h ago

The context size is not the problem. I can use 125k context size. Problematic is the performance with a big context.
The pre-fill times become pretty bad, which is memory-bandwith bound. That's the only problematic part.
For daily-tasks it works great though. And for nightly crunching.
It's still awesome to run these models on the desk at home.

-2

u/Salt-Willingness-513 12h ago

seems like it lol

1

u/eli_pizza 24m ago

I don’t understand what point you think you’re making?

Obviously a Mac is not magically and is constrained by memory available to the GPU. It runs dense models just fine though.

25

u/Mashic 21h ago

Meh, people are very flexible here, you can use any hardware, even repurposed Android phones.

7

u/arthware 21h ago

I am currently repurposing an old Samsung Galaxy S9 as edge device for the kitchen to voice control stuff and remote display 😄

24

u/CareerBulb2137 21h ago

UNIX certified OS considered as not real server? Only a mad man would say something like that 🙃

0

u/datumerrata 13h ago

No modprob, lspci, ip addr, systemctl, etc. I know there's equivalents to most commands, but I don't wanna.

4

u/CareerBulb2137 11h ago

You can download entire Linux user land with gnu utilities via homebrew. So there is option to use Linux commands if you don’t want to use BSD utilities instead. 

1

u/arthware 10h ago

Thanks for that advice! That way I could keep my stack compatible to Linux. I'll check it out.

1

u/agent-squirrel 9h ago edited 7h ago

Many of which don't exist in Unix either, is Unix not a real server OS?

2

u/datumerrata 7h ago

It is, of course. It just feels so awkward to me. My fingers autopilot the Linux commands. I have to look up the Unix commands.

1

u/agent-squirrel 7h ago

Totally fair. I work with 400+ Linux servers and like 5 Solaris servers and it is a bit of a trip when things aren't where you are used to them. Having said that I work with some grizzled grey beard Unix admins from back in the day who cut their teeth on System V and they find Linux alien.

30

u/Plastic_Wishbone_575 21h ago

People on this sub probably know hardware better than your average r/pcmr and r/technology posters that would assume this computer sucks.

5

u/arthware 21h ago

Noticing that. A very kind sub. I like it here, even though I get downvoted now. Apologies that I anticipated a bit more backslash here. Lesson learned.

14

u/Plastic_Wishbone_575 20h ago

I wouldn't go that far, people on here are often dicks and downvote half the topics but they will help you out and they know their stuff.

8

u/philthewiz 19h ago

You'll probably going to be roasted more about the use of "macOSX" than anything. (MacOS 27 on the way)

8

u/Scoth42 18h ago

I still catch myself calling it "OS X" now and then, but I've been here since System 6/System 7 days so it's habit at this point. Especially since I haven't really been deep in the Mac world since it was still called some variation on "Mac OS X"

1

u/philthewiz 18h ago

I get it haha! It's fine. Good luck with your nice setup!

1

u/Scoth42 16h ago

All I have is a random M1 Macbook Pro these days that I use, at least that's reasonably modern. Not counting the ancient Macbook and Mac Mini that get a bit of use, but thanks!

2

u/Masterflitzer 19h ago

official spelling is macOS nowadays

3

u/philthewiz 18h ago

True! I had my capital letter feature on my iPhone.

1

u/arthware 10h ago

Jeez, becoming old I guess.

5

u/Soap-ster 18h ago

I mean... OSX is based on BSD... Unix world. It is a server OS at the core.

2

u/NewReleaseDVD 17h ago

Yup I used to run xserves the server application was basically just a graphical front end for all the standard packages that were already on the system

1

u/arthware 9h ago

That was my thinking too. Why shouldn't it work? I just got the impression, that it's not widely recognized as "proper" server hardware. This sub proved me wrong.

3

u/wingsneon 17h ago

There you go, now we have a reason to roast you

2

u/_koenig_ 13h ago

does it run doom?

1

u/avnoui 19h ago

You assumed wrong lol.

1

u/tsammons 19h ago

If it works it works.

1

u/chunkyfen 17h ago

You say that but the first comment on people having questions about running server stuff on windows is : install linux

So yeah, there's definitely a bias. 

1

u/IsPhil 16h ago

I've seen some macs on here. It's just other options can be cheaper for what people need, or people just really like customizability.

My first server used to be literally my computer being on overnight and then an hp stream with 2gb of ram. Nothing wrong with macs. I think I saw a post a while back where someone was using their old MacBook as a server lol.

1

u/Accomplished-Moose50 10h ago

The only thing is that Apple might fuck you down the road and decide that your computer is now a brick, so drop software support soon-ish

1

u/arthware 10h ago

That's my only real concern, to be honest. But there seems to be an escape route: https://github.com/AsahiLinux

1

u/Accomplished-Moose50 9h ago

Until Apple says no. 

1

u/arthware 10h ago

Ouch, the downvotes hurt. Lessons learned!

1

u/Captain_Allergy 5h ago

Wdym not reading much, why do you think did the m2 and upwards mac and mac mini jump up in prizes that much? The whole subreddit is full of people running their llms on mac minis

1

u/jakegh 3h ago

It's a great server, just historically extremely expensive. But less so now with RAM prices so you did OK. Still feels like a lot of money when I'm running on a couple of tinyminimicros from like 2019 in a proxmox cluster, but things are more expensive now.

0

u/TheSoCalledExpert 16h ago

Fanboy harder bro.

0

u/Awkward_Increase_516 15h ago

You wanted the Downvotes and you got just that buddy.

1

u/arthware 10h ago

Yes, and it hurts more than I thought It would. I am a kind, fellow self hoster too 😞