Questions tagged [amazon-ecs]
Amazon Elastic Container Service (ECS) is a highly scalable, high performance container management service that supports Docker containers and allows you to easily run applications on a managed cluster of Amazon EC2 instances.
110
questions with no upvoted or accepted answers
5
votes
3
answers
4k
views
Best way to log to two different CloudWatch log streams from an ECS container?
We are running our services on AWS's ECS platform, and we send our logs to AWS CloudWatch.
We have two types of logs, any container can produce either type:
the usual application logs (access, error,...
- 601
5
votes
1
answer
867
views
ECS Stopped Task not Releasing Port
I have an ECS cluster with ELB. Last night I saw that a task was stuck in restarting loop. From the service Events log, it said:
"service xxxxx was unable to place a task because no container
...
- 51
4
votes
0
answers
1k
views
Autoscaling AWS ECS services with soft limits
As per the service utilization documentation it is possible to have a Memory utilizations over 100% when using soft limits in the ECS tasks (because you don't want to kill your app with hard limits). ...
- 291
4
votes
1
answer
4k
views
Unable to start task in ecs. Tasks are in PENDING state
My tasks are in PENDING status
That's what I can see in the events
There is not many information in the service events.
Here is the task definition in json
{
"requiresAttributes": [
{
...
- 3,488
3
votes
0
answers
1k
views
How does a unix socket shared through a Docker volume work compared to TCP?
I'm wondering how Docker manages a unix socket when it's shared across containers and how it affects the performance compared to just using TCP.
What I'm trying to accomplish is setting up docker-...
3
votes
0
answers
269
views
Are there any non-fault reasons why ECS Fargate could stop/restart my task?
I'm evaluating ECS Fargate for a project where I'm planning to run a stateful server. Are there any reasons (other than host faults, or other non-recoverable errors) why ECS/Fargate would restart or ...
- 131
3
votes
1
answer
2k
views
How do I attach, format and mount a volume on boot in ecs?
I want my persistence (ebs) volume to be separate from my auto-scaling group launch configuration. So that it won't be accidentally auto deleted by terraform, or something. Also I may do something ...
- 1,566
3
votes
0
answers
988
views
How can I clone a private repo in ECS docker container?
Hi I'm new to AWS ECS and I'm trying to deploy a docker cluster. I have a private github repo that I want to download to my working directory when my docker container starts, or possibly have it on ...
- 219
2
votes
0
answers
643
views
Why can't my ECS Fargate cluster write to my mounted EFS volume, all deployed with Terraform?
I've got a Terraform deployment that deploys a Docker image into ECS Fargate. It attaches an EFS volume to the container. When I SSH into the container, I see the volume mounted, but I am unable to ...
- 131
2
votes
1
answer
246
views
How to view and interact with terminal logs generated by AWS ECS
How do people view and interact with terminal logs generated by AWS ECS?
I've been using the ECS task view so far, but I feel the UX is bad and the Cloudwatch UI has similar problems.
How do others ...
- 165
2
votes
0
answers
261
views
Why can't I use AWS EC2 ImageBuilder to create a RHEL based container?
In the AWS console for EC2 ImageBuilder the option to create a Container Recipe using RHEL as the base image seems to be disabled.
From EC2 Image Builder console -> Container Recipes -> Create ...
- 121
2
votes
0
answers
2k
views
CredentialRetrievalError within ECS container
Problem
I have deployed an ECS cluster and am running a job orchestration platform on the cluster. One of the containers of this platform uses the python docker api to pull a container from our ...
- 21
2
votes
0
answers
105
views
Using the "draft" feature of a GitHub PR to stop AWS CodeBuild from building on a PR change
I've set up a CD pipeline from Github to ECS for a non-profit I'm working for. The AWS CodeBuild starts every time a PR is opened, changed, or merged. Sometimes, however, PRs are opened but marked as ...
github
- 21
2
votes
0
answers
145
views
Recommendations for high-volume request logs from containers
We have a service that uses raw AWS EC2 instances to field requests. Response times are in the 2-3 ms range. That response time is important to the health and success of the service.
Part of the ...
- 21
2
votes
0
answers
704
views
Environment variables aren't availiable during SSH session to AWS ECS container
I have configured ECS containers. Everything works, however when I'm connecting to a container through SSH, there are no environment variables that are defined in a task definition.
Is there a way to ...
- 103
2
votes
0
answers
1k
views
How to deploy SSL certificates on Amazon Elastic Container Service?
I have a proxy server (nginx) which has the following responsibilities:
proxies to different backends depending on resource requested
enforces rate limiting and IP blacklisting
handles rewrites and ...
- 291
2
votes
0
answers
2k
views
AWS Application Load Balancer 502 Bad Gateway
I am using AWS ECS Fargate and have an application load balancer to forward all the connections to the correct instance.
I did already manage to get up a cluster and a service up and running ...
- 51
2
votes
0
answers
1k
views
Docker storage re-mounted in read-only mode when container is generating a lot of large file(20G+)
I am getting stuck with an issue for a couple of days, and hope someone here could help or give some hints.
So here is the issue: when I am running some docker images which performs large I/O ...
- 21
2
votes
1
answer
1k
views
How to replace ECS cluster instance ami to a different kind of ami while avoiding downtime?
The company I work for uses Amazon ECS.
There are 5 or more production clusters configured there and there was some problem last week and AWS support team recommended us to change the ECS instance ...
- 10.8k
1
vote
1
answer
80
views
NAT gateway costs on AWS
I have a django app on AWS using ECS Fargate behind a VPC. A NAT gateway is required with this setup, but most of the costs are from the NAT gateway.
How I can reduce this? My docker image is 600 MB. ...
- 119
1
vote
1
answer
183
views
Can't get nginx resolver to work
I'm facing issue with nginx when a container in network change his IP , i can access it in Linux OS But nginx didnt resolve the new IP... I searched alot about a solution and i see that nginx tell us ...
1
vote
0
answers
64
views
AWS Batch on Fargate is not allocating the correct number of vCPUs
I have a web application offloading some resource-intensive tasks to AWS Batch, backed by Fargate.
It's a very simple setup - a single queue, a single job definition, and a single compute environment. ...
- 111
1
vote
0
answers
559
views
ECS deployment gets stuck on In progress
So I created this ecs cluster with ec2 a few months ago and it worked for a while,I made some changes a long the way and it stopped working. The service wasnt ready for production so I didnt mind. But ...
- 189
1
vote
0
answers
161
views
Unable to push metrics to Datadog ECS service from other services in the same ECS cluster
I have some services (say alpha, bravo and charlie, all of which are Spring boot) running in my ECS cluster as separate services. I also have deployed a service that runs Datadog agent, named dd-agent ...
- 111
1
vote
1
answer
190
views
WireGuard default route in AWS ECS container
I have a container inside an AWS ECS instance.
I want to establish a connection to a WireGuard server from that container.
The connection itself works but I have issues with routing all the traffic ...
- 111
1
vote
2
answers
2k
views
How to make my ECS Task pull my ECR image
I am trying to create a ECS task and be able to access and pull from ECR, but I am getting an error. How can I resolve this issue?
Raw error:
Cannotpullcontainererror: pull image manifest has been ...
- 111
1
vote
0
answers
170
views
which ECS task network mode?
I have an Application Load Balancer in a private subnet (used by API Gateway) that targets an ECS task. I want that task to only be accessible from inside the VPC, not from the internet, but I do have ...
- 11
1
vote
1
answer
1k
views
Why Can't I access my website ,even if 80 port of my ecs server is open?
Os system of ecs server :ubuntu.
Os of my computer:win10.
I deployed my web project to my ecs server. I could access my project online until I installed the ufw on my ecs server. I configured the ...
- 11
1
vote
2
answers
815
views
How to configure service discovery in aws ecs using the new console
In the classic AWS console it was possible to configure service discovery. It looks like this has been dropped in the new console.
How does it then need to be done in the new console?
Thanks
- 11
1
vote
1
answer
1k
views
ECS restarts due to health_check failure when multiple other requests are slow to return
We noticed that our ECS Fargate backend services restart due to a health check response timeout:
(service our-site-com-stack-BackendApiServiceStack...) (port 8000) is unhealthy in (target-group arn:...
- 111
1
vote
0
answers
417
views
Mounting EC2 directory with existing data to Fargate container using EFS
I have an EC2 instance with a huge directory(ex. /large-dir) that containers need to access. Both instance and container share same network and security group. I'm able create and mount an EFS to ...
- 55
1
vote
0
answers
398
views
Running certbot on an ECS instance
I am trying to run certbot on an ECS instance which is running a docker image (docker.io/existdb/teipublisher). The image runs well and I have associated it with a custom subdomain teipub.dh-dev.com ...
- 151
1
vote
1
answer
4k
views
(ServiceNotFoundException) when calling the UpdateService operation through CircleCI
As stated, running this through the aws-ecs orb for circleci. Error
An error occurred (ServiceNotFoundException) when calling the UpdateService operation:
I've already looked at https://discuss....
- 11
1
vote
0
answers
467
views
How to change the instance count of an ECS EC2-moded cluster?
When you create a cluster, you declare an instance count and that number of EC2 instances are created. When you even tweak the entries in the associated security-group, ECS will re-fill all of its ...
- 570
1
vote
0
answers
402
views
Service Creation failed AWS ECS Service with elastic inference accelerator (EIA)
I am trying to create a service in my ECS cluster to run a task that uses elastic inference accelerator (EIA). However, when I try to create the service, I get the following error:
I have read the ...
- 113
1
vote
0
answers
63
views
should I do task definition for nginx and nodejs seperate or together?
I want to up four nodejs containers and one nginx container on my ec2 with ecs.
So I know that I need to create task definition for nodejs image, and service to run this task.
In the service I set ...
- 111
1
vote
1
answer
272
views
Production-ready Node/React app - memory utilization issues
I have an app that is deployed on AWS using ECS and recently facing some issues with memory utilization.
To give you a little background:
Our app is Node.js (specifically Sails.js) backend with ...
- 183
1
vote
0
answers
91
views
Amazon ECS Batch job failing after six hours
We have an AWS Batch system that processes geospatial imagery out of one S3 bucket and into another. It has an instance policy allowing it to access the buckets. The system kicks off quite a few ...
- 46
1
vote
1
answer
4k
views
Docker labels for ECS containers
I'm new to using labels with Docker containers, but I noticed that the labels I add to my images during build are ignored by ECS when I deploy a task definition.
I can see that I can add the labels ...
- 97
1
vote
0
answers
252
views
ECS task definition versioning
We have two clusters for deploying ECS tasks - staging and production. When registering new task definition, in container definition we set ENVIRONMENT variable (can be "PRODUCTION" or "STAGING"). ...
- 137
1
vote
0
answers
242
views
The idiomatic approach to mounting "configuration" volumes on ECS?
I have a docker container that I would like to "port" to ECS. My Dockerfile contains a VOLUME instruction:
VOLUME /app/configuration
So using docker on a linux machine, you just point to the ...
- 111
1
vote
0
answers
53
views
In ECS, how to mount container's user home and host's user home?
In ECS, how can I mount volumes the container's userhome and host's user home?
"containerDefinitions": [
{
"name": "web",
"image": "nginx",
"cpu": 99,
"memory": 100,
"portMappings": [
{
"...
- 111
1
vote
0
answers
632
views
AWS - ECS with ELB not working, instance IP works though
I've set up an ECS cluster with a single container, with an ELB to serve the traffic to it. The ELB listener is HTTPS/443, and the host listener is HTTP/8080. I.e. when you hit the URL it's HTTPS but ...
- 11
1
vote
1
answer
941
views
Routing HTTP traffic to user specific Docker containers dynamically
I am attempting to architect a service which would run user specific java processes within Docker containers in AWS (ECS most likely). One java process per container per user. The only exception to ...
- 11
1
vote
1
answer
479
views
Failed creation of IAM Autoscale role when adding autoscale to a ECS task
I am adding some auto scaling setting to a ECS task
The idea is I will spawn new service when the length of the message queue increase, otherwise decrease
After I put in the definition as defined ...
- 3,488
1
vote
1
answer
530
views
How to run multiple neo4j instances on ecs?
How to run two instances of neo4j on EC2 Container Service.
I created two task definitions to run neo4j on 7474 and 7475.
But both neo4j instances use same 7687 to provide data.
It works fine with ...
- 199
1
vote
0
answers
689
views
How to autoscale a rabbitmq container in ECS
In a container based micro service application, How to autoscale rabbitmq container in ECS?
Do I have to scale it up with dynamic ports and assign to a load balancer?
- 199
1
vote
0
answers
1k
views
Send haproxy logs to cloudwatch
We're running an haproxy container on ECS and struggling to setup logging.
The ECS container definition contains the log configuration set out in the AWS docs
"logConfiguration": {
"logDriver": ...
- 301
1
vote
0
answers
43
views
How to specify an iface to map container port on AWS?
I have an EC2 instance with eth0 and eth1 interfaces that runs 2 docker containers. Now I want to map port 5000 of container0 to port 5000 on host to eth0 and port 5000 from container1 to eth1. Is it ...
1
vote
0
answers
1k
views
Pinging (ICMP) Docker container on AWS ECS
I've got a script running in a Docker container that listens for ICMP packets. If you ping the container IP address, it picks them up and sends an email.
However I'm having a bit of difficulty ...
- 65