Props to @Mediatemple for guiding me on how to fix that small issue. Site performance should be steady now.