i think ive discovered why the system keeps falling over after 24-48 hours. its been haunting me since earlier this year, and seemed to get worse when the messaging queues exploded in quantity from the 1.5.0 upgrade.

its redis. redis-bg-save thing seems to get larger every time it runs until its gobbling up huge amounts of ram while attempting to write it all to disk, causing an unseen disk bottleneck and ram shortage.

ive disabled the redis background save, which makes it entirely ephemeral so… will lose the cache on reboot, but lets see if it solves the primary issue.

ive tuned the number of message workers, and opened up the rate-limiting to lemmy.world to a functional value. posts should come in at a decent rate now.

so far, so good!