Questions tagged [amazon-eks]
The amazon-eks tag has no usage guidance.
95
questions
0
votes
0
answers
14
views
Use Node IP's instead of Pod IP's for egress with Secondary CIDR
I'm working with an Amazon EKS cluster that uses AWS VPC CNI for networking and has a custom network configuration. The primary IP address of the nodes is in the range 10.x.x.x/x, and there are ...
0
votes
0
answers
10
views
Unable to enable Singlestore studio in Singlestore kubernetes operator
I deployed a singlestore test cluster using the documentation from https://docs.singlestore.com/db/v7.3/deploy/kubernetes/ on AWS.
The deployment was successful, and I managed to get the cluster up ...
0
votes
0
answers
13
views
Issues with Kompose tool while converting docker compose to k8 mainifest
how to resolve issues while converting docker-compose to k8 manifest files.
I am getting errors once use the Konvert tool forbidden errors. any simple way to convert docker-compose to k8 manifest
0
votes
1
answer
37
views
No out of pod networking on EKS cluster
I have an EKS cluster(1.24) launched with Terraform's AWS EKS module. System generated security groups. Private or public subnets.
Cluster Inbound:
Node Inbound:
Node Outbound:
The cluster has 1 ...
- 11
0
votes
1
answer
35
views
Does AWS EKS 1.27 have Graceful Node Shutdown enabled by default?
I'm not sure if the GracefulNodeShutdown feature gate is enabled in EKS 1.27.
I know that for regular vanilla Kubernetes 1.27 is set to true by default GracefulNodeShutdown since 1.21.
But I can't ...
- 181
0
votes
0
answers
11
views
Assign permission to EKS cluter using IAM groups
Following this tutorial: https://archive.eksworkshop.com/beginner/091_iam-groups/test-cluster-access/ - Which I believe is missing the point it is trying to make, by assuming the role directly at the ...
- 101
0
votes
0
answers
37
views
Kubernets: what exactly needs to be installed on each server/node and how?
I have coded AWS instances that can serve as nodes where my containers will run. So by default each of these instances have docker installed. This part is working fine.
Eventually i would like to ...
- 97
0
votes
1
answer
148
views
EKS service SSL endpoint
When creating a service using EKS, it is exposed using http through a AWS load balancer.
kubectl apply -f service.yaml - Will create a load balancer that's managed by EKS, and can not be modified. any ...
- 101
0
votes
0
answers
134
views
How to configure the Kubernetes plugin in Jenkins
I have Jenkins Master running on an EC2 in AWS. I then created a pipeline in EKS. Both the Jenkins Master and the pipeline are running in the same VPC. It is from the Jenkins Master that I create ...
0
votes
0
answers
51
views
SecurityGroupPolicy not applied to DaemonSet
In my EKS cluster, I have a deployment and a daemonset.
The following SGP binds my deployment's pods to a couple of SecurityGroups I need:
apiVersion: vpcresources.k8s.aws/v1beta1
kind: ...
- 299
2
votes
2
answers
687
views
Debugging Prometheus OOMkilled despite 6Gi limits
I'm at the end of my patience with a prometheus setup leveraging kube-prometheus-stack 44.3.0 (latest being 45).
I have two environments, staging and prod. In staging, my prometheus runs smoothly. In ...
- 131
1
vote
1
answer
553
views
How do I enable containerd?
When I run systemctl status containerd, I get the following output:
● containerd.service - containerd container runtime
Loaded: loaded (/usr/lib/systemd/system/containerd.service; disabled; vendor ...
- 273
1
vote
2
answers
492
views
How to debug containerLogMaxSize not taking effect on the kubelet?
I'm running the following EKS version:
kubelet --version
Kubernetes v1.22.12-eks-ba74326
I've set the following parameter as documented here.
"containerLogMaxSize": "100 Mi"
I ...
- 273
0
votes
1
answer
1k
views
AWS EKS Cluster : InvalidParameterException: Unsupported Kubernetes minor version update ,Terraform Gitlab CI
The following errors occur every time I run the pipeline
│ Error: error updating EKS Cluster (business-staging) version: InvalidParameterException: Unsupported Kubernetes minor version update from 1....
- 59
0
votes
1
answer
1k
views
Kubernetes upgrade from 1.21 to 1.22 caused Prometheus to fail
We recently upgraded Kubernetes 1.21 to 1.22 version on aws eks. The upgrade was successful. However, the associated prometheus deployments fails with error
$ kubectl -n monitoring logs prometheus-...
- 103
0
votes
0
answers
1k
views
How to create EKS cluster with VPC CNI addon via CloudFormation?
I create a EKS cluster (1.24) via cloudformation, it works fine without a CNI plugin but fails when I add vpc-cni addon:
AddonCNI:
Type: 'AWS::EKS::Addon'
Properties:
AddonName: vpc-...
- 243
0
votes
0
answers
204
views
Wordpress keeps redirecting to wp-login.php after nginx-ingress update
I have a WordPress site that is working on an older version of Kubernetes. I updated the Kubernetes cluster and the nginx-ingress controller. After the update the main page works, but when we ...
- 1
2
votes
1
answer
2k
views
How do i fix terraform invalid JSON policy
I am trying to use a file which contains load balancer iam policy for my AWS in terraform. However when i run the terraform script, i get an error stating:
Error: "policy" contains an ...
- 123
0
votes
1
answer
926
views
How do i add a security group as an inbound rule to another security group in terraform
I have a Terraform codebase which deploys a private EKS cluster, a bastion host and other AWS services. I have also added a few security groups to the in Terraform. One of the security groups allows ...
- 123
0
votes
0
answers
673
views
Enable Vault JWT using `-tls-skip-verify` with EKS ca.crt fails with `x509: certificate signed by unknown authority`
We need to enable JWT auth in vault which is hosted within our EKS cluster in preparation for using K8s 1.24 OIDC and testing token renewal with Vault. I'm following documentation from a few places:
...
- 355
0
votes
0
answers
130
views
Pull image in AWS EKS cluster from on-prem Docker proxy server protected by VPN
I have a kubernetes cluster in AWS EKS. From the cluster, I need to pull Docker images from an on-prem proxy server.
When pulling the images from my local machine, I must create a VPN connection to ...
1
vote
1
answer
484
views
Keycloak w/ EKS + ALB (401 after auth)
I’m currently trying to get Keycloak to run in EKS behind ALB and for the life of me, I can’t get it to work. I get the redirect to a login screen and after I log in - I instantly get presented with ...
- 21
1
vote
0
answers
4k
views
Kubectl generates TLS handshake timeout with private EKS cluster
I'm seeing the following error when running any kubectl command and no data is returned. This error occurs when accessing a private AWS EKS instance over a VPN connection.
$ kubectl get pods -A -v=9
...
- 11
1
vote
0
answers
463
views
EKS: kubectl exec does not respect streamingConnectionIdleTimeout
Using EKS with Kubernetes 1.21, managed nodegroups in a private subnet. I'm trying to set the cluster up so that kubectl exec times out after inactivity regardless of the workload being execed into, ...
- 11
0
votes
1
answer
2k
views
Pod assigned node role instead of service account role on AWS EKS
First some info about the setup:
EKS version: 1.21
eksctl version: 0.77.0
AWS Go SDK verion: v1.44.28
Deploying using kubectl
I have a k8s cluster on AWS EKS on which I am deploying a custom k8s ...
- 111
0
votes
0
answers
910
views
Configure EKS to use Nexus Private Docker Registry (HTTP/HTTPS)
I've created an EKS cluster on AWS along with Nexus Repository on DigitalOcean using Terraform & Ansible.
Also I've not created any SSL for the Nexus Repository, so it is "http."
...
1
vote
1
answer
305
views
AWS Site-to-Site VPN ping working, TCP not
I want to establish a site-to-site IPsec VPN connection between an AWS EKS-Kubernetes-Cluster and a server from a different provider using AWS Site-to-Site VPN.
Pings get through the VPN, but TCP ...
- 11
0
votes
0
answers
128
views
Temporarily take kubernetes cluster offline
I have a kuberbetes cluster running in EKS. We use it for testing periodically but mainly it just sits there with all its nodes and costing us.
I am looking for the most elegant way to turn it off so ...
- 522
1
vote
0
answers
3k
views
Updating ingress-nginx helm chart for kubernetes 1.23.5
I am having lots of issues that seem to stem from upgrading my kubernetes cluster to the latest version (1.23.5). I initially had some issues with the cluster itself and the nodes but that seems to be ...
- 111
0
votes
1
answer
249
views
Direct Traffic from a Pulbic ALB to an Internal ALB for EKS
So I have an EKS cluster sitting in a dedicated VPC (EKS-VPC)
In my Main VPC I have a public-facing ALB that I want it to somehow direct traffic to services running in EKS.
More specifically I want ...
- 121
0
votes
1
answer
223
views
Why does 'kubectl' sometimes return a *node* name instead of the *pod* name if the specified pod no longer exists in the cluster?
Sometimes kubectl get pod some-pod-1234abc returns an error like: Error from server (NotFound): pods "ip-192-168-55-196.us-east-1.compute.internal" not found. This is surprising because the ...
- 103
0
votes
1
answer
966
views
Is it possible to mix instance types in an AWS cluster?
I'd like to know if it is possible to mix node instance types in an AWS (EKS) cluster.
I'd like to host something which requires more resources and add it to the cluster.
- 1,385
1
vote
1
answer
587
views
Managing K3s Cluster with AWS EKS
I'm wondering if I can use an EKS managed node to be the control plane for a K3s cluster deployed on an edge/IoT device, such as the Intel NUC. My goal is to have a lightweight kubernetes distro to ...
- 13
0
votes
1
answer
664
views
Using the AWS VPC CNI add on for EKS can I access a pod directly via it's vpc ip address over a vpn?
My general question is in the title. I feel like I've misunderstood the way pods are connected to the VPC. I was assuming this would make pods routable on the vpc but it seems like this is not the ...
- 103
1
vote
0
answers
2k
views
Amazon EKS: Moving pods from one node group to another
I currently have a Managed Node Group serving my EKS cluster and have added another:
NodeGroup1 [current - 20gb ec2 disk]
NodeGroup2 [new - 80gb ec2 disk]
I'd like to migrate my current pods from ...
- 23
3
votes
2
answers
3k
views
How can I get Egress Static IP per namespace within a EKS cluster
My current setup involves an EKS Cluster with multiple namespaces (multi-tenant) across many different EKS nodes in private subnets. I would like the egress traffic from the pods to have a dedicated ...
2
votes
0
answers
724
views
How do you route to a mix of HTTP and HTTPS backends from an ALB Ingress?
I have a Kubernetes cluster running in EKS (on AWS.)
In the cluster I have Elasticsearch, Kibana and various other web services.
I would like to set up a single ALB loadbalancer such that:
Requests ...
- 395
1
vote
0
answers
521
views
How can i route pods in a EKS cluster to a specific NAT Gateway within the same subnet
Am running an EKS cluster deployed on a node (in public subnet) with two namespaces, one pod running in each of the namespaces. I have created two NAT gateways on the same subnet. I would like to ...
0
votes
0
answers
747
views
AWS ELB(classic load balancer) response is too slow and sometimes response is not coming it is showing timed out
I have EKS cluster setup in private subnet in which i'm having my microservices and for each microservice i have classic load balancer to access API. But response is having high latency and sometimes ...
- 21
0
votes
1
answer
471
views
Can't access RDS instance externally
I've spun up an RDS postgres database in an existing VPC (which has both public and private subnets - connected to a NAT gateway) which I've set as publicly accessible.
I've added the relevant IP ...
- 23
0
votes
1
answer
614
views
Unable to grant additional AWS roles the ability to interact with my cluster
I am trying to learn AWS EKS and following Getting started with Amazon EKS – AWS Management Console and AWS CLI guide step by step except for the region which I have changed to us-east-1.
I am able to ...
- 101
0
votes
2
answers
10k
views
AWS EKS add-on coredns status as degraded and node group creation failed( is unable to join Cluster)
I'm trying to create node group on EKS Cluster(region = ap-south-1) but it is failing to join cluster. Health issues : NodeCreationFailure Instances failed to join the kubernetes cluster
I found that ...
- 21
0
votes
1
answer
251
views
Hashicorp Vault - AWS EKS vs EC2
Is it possible to install a Hashicorp Vault cluster to EC2 only or is EKS required and would there be a big advantage to one over the other?
- 33
1
vote
1
answer
848
views
do I need kube-proxy and vpc-cni addons when running fargate only eks cluster?
they both seem like good add-ons when you're running node groups; I'm assuming given Fargate mandates ALB's would register IP only for services, and other similar fargate requirements, do we still ...
- 537
1
vote
1
answer
2k
views
coredns deployment fails looking for nodes even after fargate profile patch
Problem with installing fargate profiles and coreddns addon; I'm using terraform for some parts and kubetctl for others, the fargate profiles are created via terraform:
fargate_profiles = {
kube-...
- 537
0
votes
2
answers
1k
views
AWS EKS Ingress Timeout On Any Non-Root Path
We have configured an Ingress resource on our EKS cluster with rewrites from /.* on the load balancer to the matching URI upstream. If we visit staging.my-domain.com/, we see a successful health-check ...
- 181
3
votes
0
answers
725
views
EKS - Use IAM roles for service accounts on multiple clusters
I am trying to use IAM roles for service accounts in EKS.
https://docs.aws.amazon.com/eks/latest/userguide/iam-roles-for-service-accounts.html
When it comes to create the IAM role to be assigned to a ...
- 31
5
votes
1
answer
4k
views
EKS ARM Node stuck in NotReady status - runtime network not ready cni config uninitialized
I have an EKS Cluster (AWS) named cluster-main running on
Kubernetes version: 1.16
Platform version: eks.4
CNI version v1.6.1
There are two node groups in the cluster
Cluster Name
Instance Type
AMI ...
- 121
0
votes
0
answers
481
views
Can i access an EKS cluster , if i don't have access to iam user that created it?
An AWS admin , created an IAM user , and that user created an EKS cluster. Now , we don't have access to that IAM user.
If , we try to execute , kubectl , commands on that EKS cluster from a new IAM ...
1
vote
0
answers
481
views
aws-load-balancer-controller annotations not working
I'm trying to automatically start an ALB in my EKS cluster by using the aws-load-balancer-controller
This is what the logs of my deployment look like:
$ kubectl logs -n kube-system deployment.apps/aws-...
- 123