We have a system that we are migrating from AWS to Google Cloud. The servers are containerized and deployed through Kubernetes.

We have the frontend making api calls to the backend. A lot of the time these api calls succeed.

Intermittently, we see that instead of hitting the backend, the api call fails with a 400 response, with the body content set to the generic Google error:

"400. That’s an error.

Your client has issued a malformed or illegal request. That’s all we know. "

We can't see the request hitting the backend in our logs. It's as if it's become lost inside Google.

Doing exactly the same call from the command line from inside the frontend container, or from our local machines works every time.

My questions are:

i) Has anyone seen something similar and have a workaround for the issue?

ii) How can we debug this?

fyi the request is a simple GET that looks like: "https://example.com/v1/session/12345?frontend_ip="


The error can mean several things. It will help if you can share the request you are sending (without any sensitive data).

Additionally it could be the case that they are DELETE or GET requests with body to a ingress resource (HTTP(S) Load Balancer).

In case of DELETE requests with paylaod, it is working as expected as mentioned in this doc.

In case of GET requests with payload, there is an ongoing feature request to allow them.

  • I've added the request example format. I doubt it will shed much light as there's nothing unusual about it, and it sometimes works. – Danack Apr 24 '18 at 17:04
  • Can you take logs from client and server sides and provide them for a request that failed? Also, if there is payload in a GET request you will also get the 400 error issuetracker.google.com/36886282. – cryotek Apr 26 '18 at 8:55
  • Cryotek - that's actually quite likely to be it. Could you update your answer to be that and I'll accept it. – Danack Apr 26 '18 at 10:49
  • The issue for me was trying to add a payload to a GET request. – Michael Hays Feb 18 at 2:02

Your Answer

By clicking “Post Your Answer”, you agree to our terms of service, privacy policy and cookie policy

Not the answer you're looking for? Browse other questions tagged or ask your own question.