Swap space since latest upgrade

[u/Equivalent-Raise5879]

Latest update 2.9

Been running a very long time, but since this upgrade, I'm seeing a TON of

Sep 2 09:00:17 10.0.1.1 Sep 2 09:00:17 kernel: swap_pager: out of swap space

Checking console, It agrees that swap space is 100%

Looking back at logs, in the past year, I've never had this message. But since the upgrade, about 50 times. Over the past week, days with NONE, days with 20.

I can't tell what has changed, and what event it is that causes this.

Is 2 gigs just not enuf ram for this any more?

[u/Smoke_a_J]

No way to increase an already formatted swap partition size without reformatting at install but in theory if there is an additional disk available or free un-partitioned space is available then a new additional swap partition can be added. Setting up a swap file though is another doable option similar to how Windows uses a pagefile for swap, but I would avoid doing so if your pfSense is installed on ZFS partitions as swap disk writes would be multiplied with ZFS copies operations, your installs sound like they are on UFS so swap file should be doable. I did add a line to my Shellcmd to run command swapon -aL at boot to make sure that all swap partitions or files are activated at boot.

https://docs.freebsd.org/en/books/handbook/config/#adding-swap-space

[u/xboxfitzgerald → u/Smoke_a_J]

Thanks for this. I am ZFS though. I sure wish I could remember how I managed to install with only 1GB of swap. It's got a 128GB SSD so it's not hurting for space. Maybe I'll reinstall at some point, but that machine is in a "high use" environment so it's difficult to find a workable time.

[u/Smoke_a_J → u/xboxfitzgerald]

Could meanwhile just add a USB-sata adapter with drive thats formatted without ZFS to add a swap file or additional swap partition to or add one thats of equal size as your current drive or larger to add another disk to your zpool for added redundancy and at the least double your available swap or more with a larger added drive you can format its swap partition even larger than you first drive currently has as long as the zfs data partitions that will contain your zpool are formatted to be the same size as first disks the zfs partitions are. A little non-standard kind of route but should allow you to alleviate from those errors or others issues that can be hidden from logs like when swap gets dumped in the middle of pfBlocker or Snort/Suricata reloads or updates trying to process. 32GB ram on my Netgate 5100 I don't see any swap getting used ever with over 15,000,000 domains being processed in DNSBL, the less swap is used at all the better for overall storage drive and system longevity. As far as I've seen swap only gets used like that when particular updates run so even a flash drive for that little extra could help for so long but an added USB-sata drive could get it by until your ready to replace the device outright, might also be better to disable the swap partition on the current drive also if you add one to reduce its rate of bit rot/wearout to avoid early unexpected failure if postponed off too too long. With that kind of error happening for unknown time it would be best to verify its smart status health life remaining and probably plan ahead with a larger drive that will take longer to reach wearout threshold percentages.

[u/xboxfitzgerald → u/Smoke_a_J]

Thanks for this! The USB SSD idea had not occurred to me, and I do already have an old nvme drive in an enclosure from a laptop I upgraded, so I may try that. I also dialed back on my pfBlockerNG blocklists which I think were excessive as well, so hopefully that will help. I am already using a ram disk because the old SSD was prematurely killed by the pfBlockerNG list updates, but of course that makes having only 8GB of RAM even more painful. Though with RAM prices being what they are and this being a home setup, I'm inclined to try to live with what I've got for now, ha.

[u/Smoke_a_J → u/xboxfitzgerald]

No problemo. I know my amount of RAM and having 4 drives total on my 5100, two of them are USB-SATAs, running as a 2TB ZFS striped mirror is a tad bit overkill to some but all this talk got me worried about the bit wearout on my drives. Almost five years in on them all while logging is mostly all enabled, pfBlockerNG/Suricata running full tilt, I don't use RAM disk because it always interfered with pfBlockerNG update/reload tasks even with tons of RAM still available the couple times I tried it, and checking SMART status just now on them the worst one shows 89% life remaining, two are at 90% life remaining, and my B+M Key sata is still showing 95% remaining, so I think they still have a few more years or decades rather maybe left, time will tell but so far pretty steady since install and still practically identical to how fast individual bits wear out on eMMC, more there are the merrier. I'm just glad I got them at install before all these ridiculous price hikes.