I set up a new droplet with Digital Ocean and I've been enjoying it. One thing I noticed was that my sites were loading nearly twice as fast. I've been looking into securing the server, mainly the basics (forcing SSH login, ufw firewall, etc). I followed this guide yesterday. I looked at the load times for my sites and noticed that they nearly doubled. I went back undoing changes until they returned to the faster speeds. The last one I changed was disabling secured shared memory.
With secure shared memory disabled, my site load times are 350-450ms. With it enabled they shoot up to 800ms to 1.2s. Is this normal for enabling secured shared memory? If so, is the trade off worth it, or are there better alternatives?
I'm on apache 2.4, ubuntu 18.04.