So it turns out we were having two different issues from two different places happening at the same time, which made it a total pain in the ass to diagnose.
It should be fixed now so I'm gonna try turning one of them back on, so let me know if any issues pop up starting now.