Server Fault

Questions tagged [etcd]

Ask Question

A highly-available key value store for shared configuration and service discovery

72 questions
Newest
Active
Bountied
Unanswered
Filter by
Sorted by
Tagged with
0 votes
0 answers
31 views

Error from server: etcdserver: request timed out - error after etcd backup and restore

I have done the etcd backup and then a restore on the same cluster and now I'm having these issues where I can list resources but I can't create or delete. It's a 1 master and 2 workers setup , ...
user avatar
Tomas.R
  • 111
0 votes
0 answers
27 views

Why is iptables blocking return traffic?

OS: Ubuntu 18.04.6 Firewall type: IPtables. UFW is Disabled. I have Kubernetes cluster with 3 nodes that provide the controlplane and etcd services, named cp01, cp02 and cp03. I see that etcd traffic ...
user avatar
Stefan Lasiewski
  • 22.7k
0 votes
0 answers
31 views

How can I configure an etcd cluster to work with salt stack master?

The official documentation ( https://docs.saltproject.io/en/latest/ref/cache/all/salt.cache.etcd_cache.html#module-salt.cache.etcd_cache ) shows this example config: etcd.host: 127.0.0.1 etcd.port: ...
user avatar
nagylzs
  • 657
0 votes
0 answers
182 views

ETCD snapshots causing etcdserver: leader changed

For a while now we've experienced regular errors from operations on kube API in AKS resulting in etcdserver: leader changed message. From what we've learned there is an ETCD snapshot performed every ...
user avatar
Radek 'Goblin' Pieczonka
  • 381
0 votes
0 answers
163 views

Clean install of Kubernetes on Raspberry Pi doesn't work

I'm trying to do a clean install of Kubernetes 1.23.x on a cluster of four Raspberry Pis, each running the x64 version of Raspberry Pi OS, however I am running into a major snag as soon as I try and ...
user avatar
soapergem
  • 719
0 votes
0 answers
89 views

Kubernetes (Kops): Get https://127.0.0.1:4001/health: remote error: tls: bad certificate

I am seeing below error running "kubectl get componentstatus". NAME STATUS MESSAGE ERROR scheduler ...
user avatar
gmairi
  • 1
0 votes
1 answer
419 views

etcdctl endpoint health --> unhealty?

If I run etcdctl it hangs. If I use --debug=true I see: root@k8scp:~# kubectl exec -n kube-system -it etcd-k8scp sh sh-5.1# ETCDCTL_API=3 etcdctl --debug=true endpoint health {"level":&...
user avatar
guettli
  • 2,984
0 votes
1 answer
48 views

etcdctl: unknown command "save" for "etcdctl"

I entered the etcd container: kubectl -n kube-system exec -it etcd-k8scp -- sh The I try to backup the container like explained in the K8s docs ETCDCTL_API=3 etcdctl --endpoints $ENDPOINT snapshot ...
user avatar
guettli
  • 2,984
0 votes
1 answer
68 views

How to detect traffic change and trigger GitLab pipeline?

We have two etcd clusters running in Kubernetes one act as primary(A) and the second one act as backup(B). We also have etcdctl make-mirror in place between these two clusters, now the problem is if ...
user avatar
Sam
  • 101
2 votes
0 answers
141 views

Kubernetes on Flatcar Linux will not start up kube API server after a reboot of the master node

Thank you for reading and taking your time to review this problem. I have a problem using my Kubernetes cluster. It is running Flatcar Linux, made by Kinvolk, recently acquired by Microsoft. I have ...
user avatar
jonasclaes
  • 101
0 votes
0 answers
140 views

how install and run haproxy postgres and patroni under docker

I'm trying to run haproxy on a docker, but it doesn't work. 1-I create haproxy.cfg under /etc/haproxy/haproxy.cfg: global log 127.0.0.1 local2 chroot /var/lib/haproxy pidfile /var/run/...
user avatar
ksalhi
  • 1
0 votes
0 answers
841 views

How to fix etcd within a kuberentes cluster?

I have a bare-metal (kubeadm) kubernetes cluster that's really unstable, and I traced it back to an etcd issue. From the etcd pod's description I get: Image: k8s.gcr.io/etcd:3.4.13-0 Liveness: ... #...
user avatar
Antoine
  • 271
1 vote
1 answer
178 views

systemd terminates etcd service started with podman - reception only permitted for main PID

I try to start etcd as a systemd service run in a container with podman. After start I get this error log from systemd: systemd[1]: etcd.service: Got notification message from PID 4696, but reception ...
user avatar
Jonas
  • 1,139
1 vote
1 answer
608 views

How to start etcd in docker from systemd?

I want to start etcd (single node) in docker from systemd, but something seems to go wrong - it gets terminated about 30 seconds after start. It looks like the service starts in status "...
user avatar
Jonas
  • 1,139
1 vote
0 answers
201 views

How to spin up a ETCD docker container and restore a backup obtained from a kubernetes ETCD Cluster node?

I am trying to spin up a ETCD node in docker and restore a backup obtained from the Kubernetes Cluster node. ETCDCTL_API=3 etcdctl --endpoints=https://127.0.0.1:2379 --user=root:'root' snapshot save ...
user avatar
Anjula Paulus
  • 11
0 votes
0 answers
285 views

etcd cluster with DNS Discovery - client: etcd cluster is unavailable or misconfigured; Error: unexpected status code 404; dig SRV returns blank

I am configuring etcd to bootstrap using DNS discovery but it says that the server is misconfigured and it appears to be querying the wrong port, and the SRV records don't seem right. Please could you ...
user avatar
Banoona
  • 103
2 votes
0 answers
394 views

Kubernetes V1.19.13 - kubeapi servers not able connecting to different etcd database

I have upgraded Kubernets cluster ( 3 master, 3 etcd servers database) from 1.18 to v1.19.13 and ETCD to 3.4.13. since than API servers are not stable, keep switching different etcd server, because of ...
user avatar
sfgroups
  • 193
1 vote
1 answer
194 views

ETCD Cluster configuration for Kubernetes: Which one should be considered?

I would like to know how to deploy a ETCD cluster for Kubernetes. It seems like there are two different documentation and I don't know which one must be considered or the impact of each of them. From ...
user avatar
Mael Fosso
  • 121
0 votes
1 answer
2k views

Kubernetes: kubeadm join fails in private network

I'm trying to set up a HA Kubernetes cluster on Hetzner Cloud following this guide. I've created 6 servers, 3 control plane hosts and 3 workers. When trying to use kubeadm to join the second server to ...
user avatar
mway-niels
  • 11
1 vote
1 answer
459 views

How can we modify the heartbeat synchronization time of the etcd cluster on Kubernetes

I want to modify heartbeat-interval of embedded etcd cluster running on kubernetes, I know while installation we can do with kubeadm extraargs but how to do in running cluster? Before modifying I want ...
user avatar
ImranRazaKhan
  • 105
0 votes
1 answer
232 views

Centos 7, HA postgresql12, patroni with etcd v3.4

I followed this document but dont know how to enable v2 so that patroni can work with, can anyone help? https://computingforgeeks.com/setup-etcd-cluster-on-centos-debian-ubuntu/
user avatar
Tùng Nguyễn
  • 23
-2 votes
1 answer
295 views

etcd: Max Storage Size Update [closed]

Can anyone confirm whether the improvements mentioned How Does Alibaba Ensure the Performance of System Components in a 10,000-node Kubernetes Cluster? have actually been included in etcd 3.4.0? Docs ...
user avatar
Rob
  • 1
0 votes
1 answer
1k views

ETCD database cluster certificate renewal for Kubernets external database setup

I have deployed 3 node external ETCD database (etcdctl version: 3.4.7) cluster for my Kubernetes v1.18.6 cluster using etcdadm tool. my certificate is expring in couple of months. I believe kubeadm ...
user avatar
sfgroups
  • 193
1 vote
3 answers
5k views

Kubernetes OCI runtime exec failed - starting container process caused "exec: \"etcdctl\": executable file not found in $PATH": unknown

Background Created a fresh Kubernetes cluster using kubeadm init --config /home/kube/kubeadmn-config.yaml --upload-certs and then joining the 2nd control plane node by running the below. kubeadm join ...
user avatar
PieDev
  • 71
0 votes
1 answer
315 views

Kubernetes API: Compare and update config map key

Etcd has a concept of Atomic Compare-and-Update by comparing the key's value before executing an update. I'd like to use this feature for updating a ConfigMap in my Kubernetes cluster. I'd like to ...
user avatar
xpepermint
  • 257
0 votes
2 answers
84 views

Upgrade multi etcd cluster running inside docker container

Currently my k8s cluster is on v1.16.x and I want to upgrade it to v1.17.x for which ETCD has to be upgraded to 3.4 (currently 3.3). My setup is bit complex as I'm running ETCD outside the master ...
user avatar
jagatjyoti
  • 101
0 votes
0 answers
454 views

Kubernetes etcd panic: store.keyindex: put with unexpected smaller revision

After an ungraceful shutdown of our Kubernetes cluster, the API server didn't start working. After some investigation, I found the following errors in each etcd member on each node. How can I recover ...
user avatar
Ahmad Ahmadi
  • 101
2 votes
2 answers
3k views

Kubernetes - kubeadm join - Connection refused after new control plane joined

Issue I am trying to join a second control-plane node to a K8S cluster. The first node has a IP of 10.1.50.4 where the second node has a IP of 10.1.50.5. There is a load balancer Virtual IP for the ...
user avatar
Pie
  • 292
1 vote
0 answers
346 views

k3s without HA: how to switch master node?

Rancher documentation on k3s is quite nice and its HA support (both with external DB or embedded etcd) look nice, but I don't want/need an HA setup. In case my master node fails, I don't mind having ...
user avatar
Filipe Pina
  • 103
0 votes
1 answer
2k views

Error response from daemon: {“message”:“No such container: kubelet”}

When adding a new node to a Kubernetes cluster I end up with this error : + docker start kubelet Error response from daemon: {"message":"No such container: kubelet"} Error: failed ...
user avatar
TheoV
  • 1
0 votes
0 answers
342 views

ETCD client connection to etcd servers from k8s api server issue

We expect the following issue with etcd cluster. We generated certificate with the following configuration: { "CN": "client", "hosts": [""], "...
user avatar
Andrew Striletskyi
  • 25
1 vote
1 answer
1k views

TLS handshake issues with etcd

We are using external etcd cluster for k8s cluster. We connected master to this etcd server but receive "tls: first record does not look like a TLS handshake" How to fix this issues? (for ...
user avatar
Andrew Striletskyi
  • 25
0 votes
2 answers
2k views

How to recover from master failure in kubernetes

I have three nodes multi-master kubernetes(1.17.3) cluster(Stacked control plane and etcd nodes), 11.11.11.1 - master1 11.11.11.2 - master2 11.11.11.3 - master3 So before going to productions, I am ...
user avatar
ImranRazaKhan
  • 105
2 votes
1 answer
139 views

Why do kubernetes kube-api server need etcd-keyfile and kubelet-client-key

As I understand kube-api server acts as a client when communicating with ETCD and Kubelet. Both ETCD and Kubelet act as servers for kube-api. With secure environment (two way SSL authentication), kube-...
user avatar
srinu259
  • 23
0 votes
1 answer
767 views

Include own/external etcd cluster in kubeadm init

I have a running etcd cluster with five members (Own etcd cluster for Kubernetes). How can I include this in the kubeadm init command? My idea is that I generate the configuration, edit it manually ...
user avatar
uav
  • 494
1 vote
2 answers
272 views

Own etcd cluster for Kubernetes

I want to build my own Kubernetes cluster across two locations (300 km distance) and integrate it into GitLab. Let me list my ideas. My question is if I have a mistake in my thinking somewhere and ...
user avatar
uav
  • 494
0 votes
1 answer
575 views

Installing kubernetes with external etcd - calico problems

I faced multiple problems during installation of k8s multimaster cluster with external etcd. I did it before twice, on other sites, successfully, but this time I need help. calico was installed from ...
user avatar
Paul K.
  • 125
0 votes
1 answer
550 views

kube-calico bird: Mesh_172_26_178_195: Socket error: bind: Address not available

Issue appears when kube-calico service on node trying to connect master: Dec 17 12:03:41 a docker[27052]: bird: Mesh_47_105_189_58: Socket error: bind: Address not available Dec 17 12:03:41 a docker[...
user avatar
aleng1106
  • 1
3 votes
1 answer
3k views

missing '=' etcd when defining service file

I'm struggling while following Kelsey Hightower's "Kubernetes the Hard Way" tutorial. I've gone off script, because I'm trying to bootstrap k8s on a local server. I've got the point where I'm ...
user avatar
Baron
  • 61
0 votes
1 answer
360 views

Is there a way to determine to which etcd server the Kubernetes-apiserver is communicating with?

In the following scenario, is there a way to determine to which etcd server the Kubernetes-apiserver is communicating with?? Let's say we have 3 Master nodes with an external load balancer and 3 etcd'...
user avatar
Venkata Surya Lolla
  • 3
0 votes
1 answer
186 views

Does etcd resources are encrypted on gke master nodes?

I do not find any information on etcd database managed by google on kubernetes master nodes. I see how resources (pod/nodes/...) communicates, but I don't know if the data are encrypted before being ...
user avatar
Frédéric Ferchaud
  • 1
0 votes
1 answer
358 views

etcd on GCE-load balancing and health checks

I'm trying to set up a secure etcd cluster on CoreOS on top of GCE. I want to distribute load between several etcd nodes with some kind of load balancing. I want a load balancer that would have an ...
user avatar
Victor Bessonov
  • 113
2 votes
1 answer
479 views

CoreOS 1353.4.0 - How should I configure Ignition for an etcd cluster member with dynamic discovery?

Using CoreOS 1353.4.0, on DigitalOcean, how should I write an Ignition config for a machine that is to join an etcd cluster with dynamic discovery? I've written the following Ignition config (...
user avatar
aknuds1
  • 2,075
2 votes
0 answers
376 views

Weighting an etcd instance to have two quorum votes

For obvious reasons, best practice in building clusters that require distributed consensus is to use 3, 5, or another node count that has a tiebreaker in place. Sometimes, however, one has two ...
user avatar
Charles Duffy
  • 946
13 votes
1 answer
2k views

Graceful shutdown of Kubernetes cluster

We have a 4 node Kubernetes cluster, installed using Juju 2.0 and the official canonical Kubernetes charm. The sole purpose of this very local and private installation is development and testing. One ...
user avatar
Kamil Tamiola
  • 131
1 vote
0 answers
811 views

Etcd: machines can't connect to cluster

I reconfigurated my etcd cluster for working with certificates and now when i trying to start i'm getting First machine: Nov 05 16:24:43 Dm3Ch-Server-Node1 etcd[13999]: 21b9ef35413b514 received vote ...
user avatar
Dm3Ch
  • 111
1 vote
2 answers
868 views

"EtcdException: Could not get the list of servers" while running calico rkt container on coreos

I have two coreos stable v1122.2.0 machines, each one with etcd2 configured with tls. I created the certificates using https://github.com/coreos/etcd/tree/master/hack/tls-setup. now I'm trying to ...
user avatar
ufk
  • 323
5 votes
1 answer
3k views

Why would using MongoDB in lieu of etcd as a key value store be a good or bad idea? [closed]

I'd like to get general thoughts from the community as to why MongoDB for key/value would OR would not be a suitable replacement for etcd or other purpose-built key/value store system (consol, ...
user avatar
DefionsCode
  • 230
2 votes
1 answer
991 views

problems configuring etcd2 for TLS

I have at home two CoreOS stable v1122.2.0 machines. both of them are registered at discovery.etcd.io properly. (i see both of them registered at https://ip:2380 when i browse to the discovery url). ...
user avatar
ufk
  • 323
0 votes
1 answer
3k views

kubelet not able to update node status

kubernetes node status reports as below. root@csp-nso-server78:~# kubectl get nodes 10.213.5.78 NAME STATUS AGE 10.213.5.78 NotReady 1h The kubelet logs show below error E0812 11:...
user avatar
Akilesh
  • 131

1
2

Your privacy

By clicking “Accept all cookies”, you agree Stack Exchange can store cookies on your device and disclose information in accordance with our Cookie Policy.