Questions tagged [autoscaling]
The autoscaling tag has no usage guidance.
283
questions
0
votes
1
answer
33
views
How to handle kubernetes workload crash-loop under load
Here is what I consider a quite generic situation for which I'm not sure what the best solution is.
Consider you have a k8s workload where pods need 10-30seconds to be Ready.
If at some point you get ...
- 474
1
vote
0
answers
44
views
AWS EC2 auto-scaling Windows server: how to set the hostname ("computername")?
I have an elaborate framework for autoscaling UNIX servers to configure their hostname with a script on launch (startup) using an NFS (EFS) where they look up what their hostname should be, then set ...
- 129
0
votes
1
answer
52
views
Unable to change "on host maintenance" option for an instance template on GCP
I've been using instance templates for Instance Groups, and I never had to go to "Advanced Options" because everything was working as expected. But today, while creating a new instance group ...
google-compute-engine
0
votes
1
answer
347
views
How to fix HPA deprecation warning on GKE?
Observed output
kubectl describe hpa
Warning: autoscaling/v2beta2 HorizontalPodAutoscaler is deprecated in v1.23+, unavailable in v1.26+; use autoscaling/v2 HorizontalPodAutoscaler
Attempted fix
...
- 119
0
votes
0
answers
31
views
Scaling up a client vpn
We are setting up an ikev2 client vpn using strongswan. So far we have managed to setup a single server using letsencrypt certificate with eap-radius authentication method. We are able to connect to ...
0
votes
0
answers
7
views
GCP: How do I set up alerting failed autoscaling for a load balancer
We had an issue with autoscaling in our prd env, where the autoscaler was not able create new VMs due to an error in the template.
We want to be pro-active on this, and set up alert whenever there is ...
0
votes
1
answer
45
views
Can multiple EC2 Auto Scaling Group policies be defined for a single environment?
Given an Auto Scaling Group with a single EC2 environment, am I able to create a scheduled scaling policy and a CPU target tracking policy for the ASG?
For example, I would like to define a scheduled ...
- 1
0
votes
0
answers
23
views
How do I define Suspended Processes in an Autoscaling Group in AWS CloudFormation?
We have a cluster of servers that need specific Elastic IPs, so we don't want the Autoscaling Group to automatically replace them when they fail healthchecks. We have accomplished this by disabling ...
- 1
0
votes
0
answers
32
views
Warmup GKE Horizontal Autoscaler
I have an application hosted on Google Kubernetes Engine that utilizes a Horizontal Autoscaler to scale automatically to the current demand (e.g. 30% CPU). In general, this works very well and allows ...
-3
votes
1
answer
42
views
Can Auto-Scaling be considered an advanced concept of Clustering?
Since using auto-scaling, it seemed to be no different from clustering except that the scale is automatically changed.
I think what they have in common is that both increase availability by ...
0
votes
0
answers
203
views
AWS Autoscaling instance group refresh without downtime?
How is it possible to perform an instance refresh within an autoscaling group without any downtime?
Running two ec2 instances with 3 public facing services running 2 tasks each.
The services have an ...
- 101
1
vote
0
answers
162
views
How can I make sure that AWS does not kill tasks before auto scaling kicks in?
I work on an AWS Fargate service which has a health check configured as well as an autoscaling policy set.
The application needs about 30 - 45 seconds to start.
The application does receive traffic ...
- 1,558
0
votes
0
answers
130
views
How to implement nightly ECS instances scale down and scale back up in the morning?
I've been given the task of reducing AWS costs by taking down ECS instances at night and starting them in the morning.
Up until now, I found only two methods and I wonder if any of you have any ...
- 10.6k
0
votes
0
answers
98
views
Can ecs services communicate with AWS AutoScalingGroup without NAT Gateway
Initially asked this question on StackOverflow but this should be the right place...
I have an architecture similar to https://github.com/aws-samples/ecs-refarch-cloudformation
I would like to know if ...
- 43
0
votes
0
answers
38
views
How to delay instance termination?
I have a very nice auto-scaling setup on AWS: whenever CPU usage goes above a certain threshold, it will launch a new instance, and when CPU usage relaxes back, it will terminate instance(s):
I can ...
- 191
0
votes
0
answers
75
views
GKE AutoProvision Cluster not reachable during node-pool creation
I am currently experimenting with GKE auto-provisioning in order to find out if this is a viable way to go for my team's use cases.
I noticed that whenever I deploy a new workload that the cluster ...
0
votes
1
answer
27
views
How do I schedule Pods so that every cluster Node has the same set of services?
I want every Kubernetes node to have the same set of pods on it.
If I scale up a deployment, I want the new pods to go on new cluster nodes that I scaled up.
Do I use required node affinity for this?
- 101
0
votes
1
answer
125
views
Autoscaling images with EBS attached
We have an AWS EC2 instance that has an EBS gp3 SSD mounted with around 70GB. Sometimes, we do some scp orders to copy new files to this EBS, but for the rest of the time, the instance will only do ...
1
vote
1
answer
1k
views
Meaning of: supplementalGroups: [ 65534 ]?
I am looking at this yaml
apiVersion: apps/v1
kind: Deployment
metadata:
name: kube-dns-autoscaler
namespace: kube-system
labels:
k8s-app: kube-dns-autoscaler
kubernetes.io/cluster-...
- 3,471
0
votes
0
answers
119
views
AWS AutoScaling - Combining Dynamic and Predictive Scaling
I'm working on setting up scaling policies for an ASG application.
I'm wondering if it is possible (or advisable) to combine Predictive and Dynamic scaling policies for a single ASG.
The peaks for the ...
- 355
0
votes
1
answer
470
views
Istio - Prometheus - HPA Stack not communicating [ HPA could not calculate the number of replicas ]
I have cluster with 1 control panel and 2 nodes.
Istio is installed as Service Mesh.
I do request management via istio ingress.
I want it to automatically scale by sharing metrics between Kubernetes ...
- 1
0
votes
2
answers
25
views
Google cloud Auto scaling - how to create vm using existing vms image
Hi I am new to google cloud. I want to use autoscaling. My question is that is it possible to use the image of my current vm as template?
Or do I have to create a fresh vm instance and create script ...
0
votes
0
answers
299
views
Run Github actions workflow ec2 auto scaled servers
Our application is hosted on AWS EC2, we add code updates & fix bugs every few weeks. Our code is on github and github actions does the deployment with automated & manual workflows. We have a ...
- 145
2
votes
2
answers
8k
views
AWS RDS: Invalid max storage size for engine name postgres and storage type gp2: 198
I'm getting this error while modifying DB instance. Invalid max storage size for engine name postgres and storage type gp2: 198 for schedule autoscaling.
This only happened yesterday, it's weird. Here ...
- 21
1
vote
0
answers
100
views
Scaling based on number of processes running on ec2 instance
I have a use case where multiple python scripts will run in parallel on ec2.
They read an SQS queue and perform operations such as download from S3, parse files, split, process, and update database.
...
- 55
1
vote
1
answer
1k
views
Terraform ECS Capacity Provider not resulting in new ECS instances on demand
From what I read here ECS capacity providers should (generally) prevent tasks immediately failing on resource limits by putting them in a "Provisioning" state and spinning up a new EC2 ...
- 1,640
0
votes
1
answer
51
views
How to configure VPC and subnet for EC2 Database accessible privately
I have an EC2 Postgres Database (not standard AWS RDS, but based on my own configured AMI)
I have a load balancer, auto scaling group with 4 max servers in each AZ (us-west-2)
My load balancer is ...
- 111
0
votes
1
answer
465
views
Autoscaling Groups: what happens during scale-in if all ec2 are termination protected?
Suppose I create an ec2 autoscaling group where each instance is protect terminated.
Suppose a min of 2 and a maximum of 4, I was wondering what happens if, in presence of a step policy:
There is a ...
- 155
0
votes
1
answer
420
views
How to minimize ecs autoscaling reaction time from terraform?
When you create an ECS autoscaling policy, two alarms tag along with it: one for scaling up ("out"), one for scaling down ("in").
The scale-out ones I see created appear to sample ...
- 103
3
votes
1
answer
769
views
What is the best metric for auto-scaling GPU instances for machine learning inference in the cloud?
We have an API in AWS with a GPU instance that does inference. We have an auto-scaler setup with the minimum and maximum number of instances, but aren’t sure which metric (GPU/CPU usage, RAM usage, ...
- 31
0
votes
1
answer
823
views
Limit max number of simulataneous connections from NLB to a specific instance
I am trying to restrict maximal number of TCP connections from amazon NLB to a target group.
Example of a desired scenario:
We have 2 instances and NLB. The first 100 users with 100 TCP connections ...
- 195
-1
votes
1
answer
568
views
Updating Azure Virtual Machine Scale Set
I have hosted a website in azure virtual machine scale set by following the below steps
Create a VM and do the necessary changes/installations in iis.
Create a snapshot of the VM. This ensure that ...
- 99
0
votes
0
answers
148
views
EBS target response time increasing before CPU utilization
I'm in a company where we have an elastic beanstalk configuration and it works fine with our CICD. The only issue is that earlier today i ran a stress test (basically just disabled AWS shield and went ...
0
votes
1
answer
335
views
Connect instances in auto-scaling group to EC2 instance (coordinator node) without using elastic IP?
I have a setup where I do batch computation using spot instances in an auto-scaling group.
The batch computation is coordinated by a "coordinator node", which is just an EC2 instance. I use ...
- 115
1
vote
0
answers
67
views
Autoscaling - lifecylehook implementation
I'm trying to implement my first ASG with a lifecycle hook and I am having this issue:
LifecycleHandlerFunction: Encountered unsupported property Role
The following resource(s) failed to create:
[...
- 13
0
votes
1
answer
188
views
AWS auto scaling, "scale in" controls
I'm trying to move off a monolithic big server, that ran many jobs, into a design that uses auto scaling to build out more servers as more jobs are run. The issue I found in testing is that when the ...
- 197
1
vote
0
answers
54
views
Why is Code Deploy not running in new instances generated from an Auto Scale Group?
I've setup a Code Pipeline where code is being successfully pulled from Github after every commit and then a Build phase runs specs and then a Deploy phase creates a Deployment pointing to amy ...
- 111
0
votes
0
answers
249
views
GCE autoscaling based on custom metrics provided by the running instances?
I have a managed instance group with autoscaling.
Each instance runs a program that polls a remote site asking "do you have any work for me?" If the answer is "no", it goes to ...
1
vote
1
answer
122
views
What is the best way to attach instance to auto scaling?
This is my first post so hope I will get the answer.
I want to create auto scaling on my existing EC2 instance, so I found this approach so hope someone will tell me is it good ( or suggest me how to ...
- 13
0
votes
1
answer
37
views
Configure a new kubernetes node automatically
I configured a Kubernetes cluster with GPU in AWS, and one of the steps is configuring the nodes to enable Nvidia runtime by default.
So when I configured cluster auto scaler, the cluster scales up ...
- 11
3
votes
2
answers
6k
views
Why are pods failing to schedule due to resources when node has plenty available?
The pods in my application scale with 1 pod per user (each user gets their own pod). I have the limits for the application container set up like so:
resources:
limits:
cpu: 250m
...
- 280
0
votes
1
answer
448
views
How can I autoscale my Azure Kubernetes nodepool before resources run out
I did some testing today with my autoscaling setup on Azure Kubernetes. I noticed that when an autoscale was triggered, it took a while for the next node to spin up, so the last pod had to wait a long ...
- 280
0
votes
1
answer
215
views
Autoscaling with Google Compute Engine with Static IP pointing to domain name
I am looking to add autoscaling to my Google Compute Engine via the instructions I have found here: https://cloud.google.com/compute/docs/autoscaler
My original Compute Engine instance has a static ip ...
0
votes
0
answers
342
views
Targeting specific google cloud run instance through HTTP
I'm using cloud run to run a node.js app with lru-cache and auto scaling. I have created a route to allow external services to reset the application's cache. I am now looking for a way to target every ...
0
votes
1
answer
84
views
Google Run Managed - how keep a minimum number of instances and not have 0
We have a set of services deployed on google run platform managed for a web application and whenever there is no traffic, it seems the services go to sleep and then it takes a long time to wake them ...
1
vote
2
answers
3k
views
powershell user data script run on restart of the Windows instance
We have windows servers that do application initialization which takes almost 3-4 hours for servers to be online. So to avoid downtime we use autoscaling group lifecycle hooks. Now we want to shut ...
- 1,467
2
votes
1
answer
593
views
Setting up autoscaling based on network throughput
I need help in setting up autoscaling based on network throughput.
Our front instances are placed inside an autoscaling group. We want the number of instances to increase as a function of network ...
- 21
0
votes
1
answer
126
views
google cloud Stackdriver Metrics to scale an Manage instance group - Regional
What are the Stackdriver Metrics we can use to autoscale Regional Manage instance groups ?
When i check the docs it says
Regional managed instance groups do not support filtering for per-instance ...
0
votes
0
answers
967
views
autoscaling php-fpm in AWS ECS
I have a t3.medium instance managed by ASG and used by ECS. My application requires approximately 25% of the capacity of this instance to operate at a minimum. will work in the standard nginx + ...
- 1
0
votes
2
answers
78
views
Production level Auto-scaling in AWS
I have completely understood the concept of Auto-Scaling in AWS. My only question is, what AMI will the launch configuration use while in production environment?
According to my understanding Image ...
Related Tags
amazon-web-services × 164
amazon-ec2 × 113
load-balancing × 23
kubernetes × 17
azure × 16
amazon-elb × 16
amazon-ecs × 12
elastic-beanstalk × 11
amazon-ebs × 8
scalability × 8
cloud × 6
aws-cli × 6
healthcheck × 6
nginx × 6
virtual-machines × 6
amazon-ami × 5
amazon-rds × 5
amazon-vpc × 5
deployment × 5
docker × 5
more related tags
Hot Network Questions
- Calculating mean with group by based on another column in QGIS Field Calculator
- Is it better to not connect a refrigerator to water supply to prevent mold and water leaks
- Why are deck joists supposed to be on top of posts, not bolted to the side?
- How can Herbert Kickl be "the odds-on favorite" with a "personal approval rating.. among the lowest of any Austrian politician’s"?
- How should I correct the drains for my dual sink and washing machine?
- "Murder laws are governed by the states, [not the federal government]." Is Vivek Ramaswamy right?
- .exe with Digital Signature, showing SHA1 but the Certificate is SHA384, is it secure?
- Why isn't the druid affected by her enchanted cuffs?
- Movie where AI or robot wears skin of person and asks for spare parts
- What does '' that '' refer to?
- What exactly is a 'hard landing'?
- How could a sapient creature lose its intelligence?
- Having a hard time ripping inexpensive 2x10 lumber. Could use a little advic
- Is there such a thing as a vector without a basis?
- Is there any cost-effective fix for this damaged bathtub drain plug, or should I just find a new one?
- How important is hygiene beyond required washing and mikvah immersion to Jews?
- Paper with potentially inappropriately-ordered authors, should a journal act?
- Visualizing point attribute (int) with multiple dots / SVGs in QGIS
- How would I go about showcasing my skills in Math Stack Exchange on LinkedIn or on Resume?
- When citing a scientific article do I have to agree with the opinions expressed in the article?
- Is understanding classical composition guidelines beneficial to a jazz composer?
- How do you check the legality of a new business model?
- If you're mounted and forced to make a melee attack, do you attack your mount?
- Does the Alert feature allow a character to automatically detect pickpockets?