Skip to main content
OverflowAI is here! AI power for your Stack Overflow for Teams knowledge community. Learn more

Questions tagged [autoscaling]

The tag has no usage guidance.

Filter by
Sorted by
Tagged with
0 votes
0 answers
55 views

AWS EC2 Autoscaling Group timeout during scale up from 0 to 1 then "Failed to find readiness information for" until manual termination

I have an AWS EC2 Auto Scaling Group for GPU accelerated g4dn-2xlarge instances. Recently we've had a couple of days where the ASG times out after 5 minutes scaling from 0 to 1 and the instance it ...
Shanteva's user avatar
  • 101
1 vote
1 answer
91 views

What should be the NodeClassRef for Karpenter's NodePool in GKE?

I have created a GKE cluster in GCP and wanted to install Karpenter on it for the autoscaling. While trying to install Karpenter, pods gives the error asking to create the NodeClaim resource which ...
Harshit Agarwal's user avatar
0 votes
0 answers
27 views

Trigger AWS Autoscale automatically

I have an Autoscale Web Application in AWS. When I don't use it, I terminated EC2 instances automatically with Lambda (with Cloudwatch). But I couldn't find an automatic structure to trigger it again. ...
MrTux01's user avatar
  • 103
1 vote
0 answers
24 views

Dynamically Update Ips of AWS Autoscaling instances in Jenkins SSH Global configuration

We have few autoscaling groups in AWS and new instances are created frequently. We are using a declarative Jenkins pipeline to publish the build artifacts to those server using publish over ssh plugin ...
S_H's user avatar
  • 11
0 votes
0 answers
22 views

How many queries will fail if an error occurs within a single process of a single host?

Context: I have a cluster of H hosts serving an API, where each hosts serves the api using P (constant) number of (python, but irrelevant) processes (asynchronously, but otherwise also irrelevant). I ...
pwoolvett's user avatar
  • 101
0 votes
0 answers
49 views

EKS provisions nodes more than maxnodes using Karpenter

Currently I am using EKS with karpenter and I provision EKS cluster with values minNodes: 1 maxNodes: 2 DesiredNodes: 1 Then I setup the karpenter using this link. After Setting it up as referred by ...
Suyog Dahal's user avatar
0 votes
0 answers
82 views

DynamoDB Auto-Scaling, Application Auto-Scaling

I'm trying to setup a set of boto3 python AWS scripts which can create new users and dynamoDB tables, so that the web app I'm working on can add new users with properly scoped permissions. I'm having ...
Devin Ceartas's user avatar
0 votes
1 answer
309 views

How to handle kubernetes workload crash-loop under load

Here is what I consider a quite generic situation for which I'm not sure what the best solution is. Consider you have a k8s workload where pods need 10-30seconds to be Ready. If at some point you get ...
mveroone's user avatar
  • 474
1 vote
0 answers
204 views

AWS EC2 auto-scaling Windows server: how to set the hostname ("computername")?

I have an elaborate framework for autoscaling UNIX servers to configure their hostname with a script on launch (startup) using an NFS (EFS) where they look up what their hostname should be, then set ...
Gunther Schadow's user avatar
0 votes
1 answer
223 views

Unable to change "on host maintenance" option for an instance template on GCP

I've been using instance templates for Instance Groups, and I never had to go to "Advanced Options" because everything was working as expected. But today, while creating a new instance group ...
Hasnain's user avatar
0 votes
1 answer
2k views

How to fix HPA deprecation warning on GKE?

Observed output kubectl describe hpa Warning: autoscaling/v2beta2 HorizontalPodAutoscaler is deprecated in v1.23+, unavailable in v1.26+; use autoscaling/v2 HorizontalPodAutoscaler Attempted fix ...
Jared Beck's user avatar
0 votes
0 answers
56 views

Scaling up a client vpn

We are setting up an ikev2 client vpn using strongswan. So far we have managed to setup a single server using letsencrypt certificate with eap-radius authentication method. We are able to connect to ...
Hamza Khalid's user avatar
0 votes
1 answer
389 views

Can multiple EC2 Auto Scaling Group policies be defined for a single environment?

Given an Auto Scaling Group with a single EC2 environment, am I able to create a scheduled scaling policy and a CPU target tracking policy for the ASG? For example, I would like to define a scheduled ...
Xamuel's user avatar
  • 1
-3 votes
1 answer
67 views

Can Auto-Scaling be considered an advanced concept of Clustering?

Since using auto-scaling, it seemed to be no different from clustering except that the scale is automatically changed. I think what they have in common is that both increase availability by ...
john_smith's user avatar
1 vote
0 answers
376 views

How can I make sure that AWS does not kill tasks before auto scaling kicks in?

I work on an AWS Fargate service which has a health check configured as well as an autoscaling policy set. The application needs about 30 - 45 seconds to start. The application does receive traffic ...
sbrattla's user avatar
  • 1,610
0 votes
0 answers
140 views

Can ecs services communicate with AWS AutoScalingGroup without NAT Gateway

Initially asked this question on StackOverflow but this should be the right place... I have an architecture similar to https://github.com/aws-samples/ecs-refarch-cloudformation I would like to know if ...
user2134216's user avatar
0 votes
1 answer
50 views

How do I schedule Pods so that every cluster Node has the same set of services?

I want every Kubernetes node to have the same set of pods on it. If I scale up a deployment, I want the new pods to go on new cluster nodes that I scaled up. Do I use required node affinity for this?
Samuel Squire's user avatar
0 votes
1 answer
256 views

Autoscaling images with EBS attached

We have an AWS EC2 instance that has an EBS gp3 SSD mounted with around 70GB. Sometimes, we do some scp orders to copy new files to this EBS, but for the rest of the time, the instance will only do ...
Learning from masters's user avatar
1 vote
1 answer
3k views

Meaning of: supplementalGroups: [ 65534 ]?

I am looking at this yaml apiVersion: apps/v1 kind: Deployment metadata: name: kube-dns-autoscaler namespace: kube-system labels: k8s-app: kube-dns-autoscaler kubernetes.io/cluster-...
guettli's user avatar
  • 3,823
0 votes
0 answers
276 views

AWS AutoScaling - Combining Dynamic and Predictive Scaling

I'm working on setting up scaling policies for an ASG application. I'm wondering if it is possible (or advisable) to combine Predictive and Dynamic scaling policies for a single ASG. The peaks for the ...
user1751825's user avatar
0 votes
1 answer
603 views

Istio - Prometheus - HPA Stack not communicating [ HPA could not calculate the number of replicas ]

I have cluster with 1 control panel and 2 nodes. Istio is installed as Service Mesh. I do request management via istio ingress. I want it to automatically scale by sharing metrics between Kubernetes ...
Orgenus's user avatar
0 votes
2 answers
38 views

Google cloud Auto scaling - how to create vm using existing vms image

Hi I am new to google cloud. I want to use autoscaling. My question is that is it possible to use the image of my current vm as template? Or do I have to create a fresh vm instance and create script ...
Bishwadeep KC's user avatar
0 votes
0 answers
437 views

Run Github actions workflow ec2 auto scaled servers

Our application is hosted on AWS EC2, we add code updates & fix bugs every few weeks. Our code is on github and github actions does the deployment with automated & manual workflows. We have a ...
MD Nasirul Islam's user avatar
2 votes
2 answers
11k views

AWS RDS: Invalid max storage size for engine name postgres and storage type gp2: 198

I'm getting this error while modifying DB instance. Invalid max storage size for engine name postgres and storage type gp2: 198 for schedule autoscaling. This only happened yesterday, it's weird. Here ...
JamesBowery's user avatar
1 vote
0 answers
181 views

Scaling based on number of processes running on ec2 instance

I have a use case where multiple python scripts will run in parallel on ec2. They read an SQS queue and perform operations such as download from S3, parse files, split, process, and update database. ...
Rohini's user avatar
  • 55
1 vote
1 answer
2k views

Terraform ECS Capacity Provider not resulting in new ECS instances on demand

From what I read here ECS capacity providers should (generally) prevent tasks immediately failing on resource limits by putting them in a "Provisioning" state and spinning up a new EC2 ...
Philip Couling's user avatar
0 votes
1 answer
63 views

How to configure VPC and subnet for EC2 Database accessible privately

I have an EC2 Postgres Database (not standard AWS RDS, but based on my own configured AMI) I have a load balancer, auto scaling group with 4 max servers in each AZ (us-west-2) My load balancer is ...
Nirav Bhatt's user avatar
0 votes
1 answer
726 views

Autoscaling Groups: what happens during scale-in if all ec2 are termination protected?

Suppose I create an ec2 autoscaling group where each instance is protect terminated. Suppose a min of 2 and a maximum of 4, I was wondering what happens if, in presence of a step policy: There is a ...
Phate's user avatar
  • 155
0 votes
1 answer
890 views

How to minimize ecs autoscaling reaction time from terraform?

When you create an ECS autoscaling policy, two alarms tag along with it: one for scaling up ("out"), one for scaling down ("in"). The scale-out ones I see created appear to sample ...
Jonas Kölker's user avatar
4 votes
1 answer
2k views

What is the best metric for auto-scaling GPU instances for machine learning inference in the cloud?

We have an API in AWS with a GPU instance that does inference. We have an auto-scaler setup with the minimum and maximum number of instances, but aren’t sure which metric (GPU/CPU usage, RAM usage, ...
elwray14's user avatar
0 votes
1 answer
1k views

Limit max number of simulataneous connections from NLB to a specific instance

I am trying to restrict maximal number of TCP connections from amazon NLB to a target group. Example of a desired scenario: We have 2 instances and NLB. The first 100 users with 100 TCP connections ...
rlib's user avatar
  • 195
-1 votes
1 answer
702 views

Updating Azure Virtual Machine Scale Set

I have hosted a website in azure virtual machine scale set by following the below steps Create a VM and do the necessary changes/installations in iis. Create a snapshot of the VM. This ensure that ...
Vishnu Babu's user avatar
0 votes
0 answers
267 views

EBS target response time increasing before CPU utilization

I'm in a company where we have an elastic beanstalk configuration and it works fine with our CICD. The only issue is that earlier today i ran a stress test (basically just disabled AWS shield and went ...
Lukas Mittun Alexander Guldstv's user avatar
0 votes
1 answer
392 views

Connect instances in auto-scaling group to EC2 instance (coordinator node) without using elastic IP?

I have a setup where I do batch computation using spot instances in an auto-scaling group. The batch computation is coordinated by a "coordinator node", which is just an EC2 instance. I use ...
Foobar's user avatar
  • 115
1 vote
0 answers
76 views

Autoscaling - lifecylehook implementation

I'm trying to implement my first ASG with a lifecycle hook and I am having this issue: LifecycleHandlerFunction: Encountered unsupported property Role The following resource(s) failed to create: [...
serialp's user avatar
  • 13
0 votes
1 answer
313 views

AWS auto scaling, "scale in" controls

I'm trying to move off a monolithic big server, that ran many jobs, into a design that uses auto scaling to build out more servers as more jobs are run. The issue I found in testing is that when the ...
RunThor's user avatar
  • 209
1 vote
0 answers
124 views

Why is Code Deploy not running in new instances generated from an Auto Scale Group?

I've setup a Code Pipeline where code is being successfully pulled from Github after every commit and then a Build phase runs specs and then a Deploy phase creates a Deployment pointing to amy ...
Erik Escobedo's user avatar
0 votes
0 answers
320 views

GCE autoscaling based on custom metrics provided by the running instances?

I have a managed instance group with autoscaling. Each instance runs a program that polls a remote site asking "do you have any work for me?" If the answer is "no", it goes to ...
JayEye's user avatar
  • 121
1 vote
1 answer
387 views

What is the best way to attach instance to auto scaling?

This is my first post so hope I will get the answer. I want to create auto scaling on my existing EC2 instance, so I found this approach so hope someone will tell me is it good ( or suggest me how to ...
mawerick_1's user avatar
0 votes
1 answer
62 views

Configure a new kubernetes node automatically

I configured a Kubernetes cluster with GPU in AWS, and one of the steps is configuring the nodes to enable Nvidia runtime by default. So when I configured cluster auto scaler, the cluster scales up ...
Sadmi's user avatar
  • 11
4 votes
2 answers
8k views

Why are pods failing to schedule due to resources when node has plenty available?

The pods in my application scale with 1 pod per user (each user gets their own pod). I have the limits for the application container set up like so: resources: limits: cpu: 250m ...
Ben Davis's user avatar
  • 290
0 votes
1 answer
653 views

How can I autoscale my Azure Kubernetes nodepool before resources run out

I did some testing today with my autoscaling setup on Azure Kubernetes. I noticed that when an autoscale was triggered, it took a while for the next node to spin up, so the last pod had to wait a long ...
Ben Davis's user avatar
  • 290
0 votes
1 answer
280 views

Autoscaling with Google Compute Engine with Static IP pointing to domain name

I am looking to add autoscaling to my Google Compute Engine via the instructions I have found here: https://cloud.google.com/compute/docs/autoscaler My original Compute Engine instance has a static ip ...
Chrono's user avatar
  • 3
0 votes
0 answers
535 views

Targeting specific google cloud run instance through HTTP

I'm using cloud run to run a node.js app with lru-cache and auto scaling. I have created a route to allow external services to reset the application's cache. I am now looking for a way to target every ...
J Dubuis's user avatar
  • 101
0 votes
1 answer
134 views

Google Run Managed - how keep a minimum number of instances and not have 0

We have a set of services deployed on google run platform managed for a web application and whenever there is no traffic, it seems the services go to sleep and then it takes a long time to wake them ...
Gregory's user avatar
1 vote
2 answers
3k views

powershell user data script run on restart of the Windows instance

We have windows servers that do application initialization which takes almost 3-4 hours for servers to be online. So to avoid downtime we use autoscaling group lifecycle hooks. Now we want to shut ...
Shailesh Sutar's user avatar
2 votes
1 answer
969 views

Setting up autoscaling based on network throughput

I need help in setting up autoscaling based on network throughput. Our front instances are placed inside an autoscaling group. We want the number of instances to increase as a function of network ...
Marcus Stein's user avatar
0 votes
1 answer
139 views

google cloud Stackdriver Metrics to scale an Manage instance group - Regional

What are the Stackdriver Metrics we can use to autoscale Regional Manage instance groups ? When i check the docs it says Regional managed instance groups do not support filtering for per-instance ...
Thulasya's user avatar
0 votes
0 answers
1k views

autoscaling php-fpm in AWS ECS

I have a t3.medium instance managed by ASG and used by ECS. My application requires approximately 25% of the capacity of this instance to operate at a minimum. will work in the standard nginx + ...
Julio's user avatar
  • 1
0 votes
2 answers
130 views

Production level Auto-scaling in AWS

I have completely understood the concept of Auto-Scaling in AWS. My only question is, what AMI will the launch configuration use while in production environment? According to my understanding Image ...
Subramanian Lakshmanan's user avatar

1
2 3 4 5 6