Wondering how everyone else looks at recourse utilization in AWS EC2 instances. For example, I'm trying to 'right-size' many of our over-provisioned instances to the correct instance type/performance specifications. In doing so, I've been sizing down to instance sizes that may have 80%+ memory utilization for a given workload.
The idea being that recourse utilization is different when working with cloud instances than when working with bare metal hardware or on-prem virtualization/hyper-visors. When using bare metal/on-prem servers/hyper-visors, admins usually look at resource utilization and want to see memory below 50% or whatever; or in other words 80%+ memory utilization look like a bad thing, and an admin would then maybe allocate MORE memory to get the baseline utilization lower. The thought being that during times of increased traffic or workload demands, the server will be able to handle it without slowing down/noticeable performance loss.
However, when working with cloud instances you're paying for used resources on-demand, you're no longer paying for your resources upfront in buying physical hardware- so theoretically you'd WANT to be using most of your memory allocation as your baseline to optimize cost savings for the instance type/size. Additionally the resources are burstable, so even at times when you go to 100% utilization, you won't see a performance drop or hangup, and so then high memory utilization is an ideal situation for sizing workloads that typically use the same amount of memory. In other words for a workload that sits between 80%-95% memory utilization 95% of the time.
I want to know if this thinking is flawed in anyone's opinion. Do admins using EC2 instances still try to keep their memory utilization low? To me this sounds like antiquated habits that no longer apply. And so long as your cpu stays below the allocated baseline % to accrue credits, and your memory stays below 100% for the majority of the time, then that is the ideal setup to minimize instance cost while maintaining same performance. Thoughts?