393 questions
0
votes
1
answer
33
views
How to properly auto-scale an ECS KCL consumer when SubscribeToShardEvent.MillisBehindLatest is always zero but still lagging behind?
I have an app deployed on ECS with auto-scalling. This app pulls from a kinesis data stream with enhanced fan-out via the latest KCL library.
I want messages to be processed as soon as possible with ...
- 324
0
votes
1
answer
97
views
TerminateInstanceInAutoScalingGroup is slow to remove the last instance
I have an autoscaling group of EC2 instances. Sometimes I need to scale it manually by calling SetDesiredCapacity and TerminateInstanceInAutoScalingGroup. It works well, except for the case when I ...
- 1,028
0
votes
1
answer
50
views
AWS Autoscaling Logic Issue
I believe I have some sort of logic issue with my auto-scaling module that is responsible for scaling my ECS tasks.
As you can see, I use dynamic scaling that's based on the resources consumption, ...
- 61
0
votes
1
answer
633
views
AWS Auto Scaling Group Stuck in 'Updating Capacity' During Scale-In
I’m using ECS Managed Auto Scaling with Target Tracking.
When the Target Tracking service performs a scale-out action, everything works as expected: the Auto Scaling Group (ASG) launches new instances ...
- 141
3
votes
0
answers
195
views
ECS CapacityProviderReservation Triggers Unnecessary EC2 Instance Launch in ASG Despite Low Task Load
I'm currently experiencing an issue where my Auto Scaling Group (ASG) is launching a second EC2 instance automatically, even though only one task is running, and CPU consumption is low. I need help ...
- 31
0
votes
2
answers
148
views
ECS-AutoScaling tasks without delay
For a service running on ECS, we have configured autoscaling at task-definition(based on metrics such as memory usage, hit count, etc.). However, when the memory reaches the set limit, there is a ...
- 41
0
votes
1
answer
54
views
ssue with Automatic Updates to Outdated Instances in CodeDeploy
I am writing to report an issue we have encountered with AWS CodeDeploy. We have observed that, under certain circumstances, CodeDeploy deploys an outdated revision of our application to Amazon EC2 ...
0
votes
1
answer
33
views
Clarification for AWS auto-scaling of instances
I created an EC2 instance; then using that instance created an AMI which is used for auto-scaling. I created the classical load balancer which originally pointed just to the original instance & ...
- 1,105
1
vote
0
answers
201
views
How to Configure Grafana Loki to Dynamically Collect and Filter Logs from AWS Auto-Scaling EC2 Instances?
Question:
I'm currently working on a project where I need to dynamically collect logs from AWS EC2 instances and visualize them in Grafana using Loki. Here are the specifics of my setup and ...
1
vote
2
answers
519
views
What is EKS Managed Node Group Module?
I was looking into EKS Managed Node Group Module documentations, and found out that there is a eks_managed_node_groups in the AWS EKS Terraform module. And there is a submodule called EKS Managed Node ...
- 11
1
vote
1
answer
1k
views
Difference between Auto Scaling Group, ECS Capacity Provider and ECS Service Auto Scaling
I'm having trouble understanding the differences between the properties for the Auto Scaling Group, ECS Capacity Provider and Service Auto Scaling. I'm using terraform to create the infrastructure and ...
- 13
1
vote
0
answers
129
views
Step scaling option disabled for ECS Fargate service
I'm trying to setup auto-scaling for an ECS Fargate Service based on SQS Queue depth.
The idea is to stay at 0 tasks until there are messages in the queue and then apply a step scaling policy to ...
- 393
0
votes
2
answers
976
views
Policy contains statement with one or more invalid principals. AWS Autoscaling
We are trying to set up autoscaling on my EC2 instance. I have followed this document. When I edit and then try to save the key policy for my webserver CMK I'm getting this error "Policy contains ...
- 11
0
votes
0
answers
132
views
User data works on individual EC2 instance but not in Auto Scaling Group
I have this user data on both an individual ec2 instance as well as the user data of a launch template but only the individual ec2 loads the website. This is done with http and both the ec2 and launch ...
- 11
0
votes
1
answer
545
views
AWS autoscaling group: Wait for first instance to finish before scaling-out again
I have a requirement when using AWS autoscaling groups:
I need to wait for the first instance to finish installation of software packages before the autoscaling group spins up subsequent instance.
...
- 27
0
votes
0
answers
173
views
AWS Application load balancer : time out on health check
I've built a website in Django that I'd like to promote using AWS Elastic Load Balancer (Application Load Balancer) coupled with an Auto Scaling Group.
For context: I'm using a VPC containing 2 public ...
- 47
1
vote
0
answers
182
views
EC2 Autoscaling group launching more instances than required
I have setup an ecs cluster with ec2 autoscaling group as capacity provider. When I deploy one service to my cluster. It launches 2 ec2 tasks(or service as there is just one task in service). And then ...
0
votes
1
answer
329
views
AWS Auto Scaling Groups with Multiple AMI
Here is out scenario. We have around 12 web servers that are active in a target group today. Those servers are always running. We monitor those servers with prometheus / grafana. Each server is ...
- 97
2
votes
0
answers
357
views
How to configure Service Auto-scaling in AWS ECS (using step scaling)
We have a number of dotNet services running in ECS which consume data from RabbitMQ queues, I want to scale up the number of instances based on the number of messages in the queues.
Let's say I want ...
- 2,530
2
votes
1
answer
665
views
ECS Agent cannot start! Unable to initialize Task ENI dependencies
I encountered a problem while starting an instance from an Autoscale Group: the ecs-agent container starts, but then encounters an error and stops. This is the error:
Unable to initialize Task ENI ...
- 23
0
votes
1
answer
291
views
AWS auto scaling group, multiple ec2 instances are running, how to set that only specific ec2 instance to access RDS?
I created the AWS auto scaling group, in that multiple ec2 instances are running, how to set that only specific/particular ec2 instance to access/connect RDS? I am new to the AWS so can anyone please ...
0
votes
0
answers
67
views
Mutually exclusive EC2 instances for same autoscaling group with different target groups
I have an AWS EC2 autoscaling group as part of an EB environment with 2 load balancer target groups attached, I'd like to route requests to either target group based on a query parameter specified in ...
- 306
-1
votes
2
answers
264
views
Is it correct to spin up a new EC2 instance to process each message in SQS for the purpose of video rendering?
I have created a python script which processes videos using Selenium on an EC2 instance, taking input from an SQS queue for each message. This works fine for a single video, but I need to process ...
- 308
1
vote
1
answer
129
views
Pushing metric data to Cloudwatch for custom auto scaling
We would like to autoscale based on SQS size.
I was able to follow the below link and add custom autoscaling policy across the auto scaling group.
https://docs.aws.amazon.com/autoscaling/ec2/userguide/...
- 441
1
vote
1
answer
359
views
AWS ECS Fargate Service TargetTracking CPU based auto scaling generate Cloudwatch alarm for Low CPU Utilization
I have ECC Fargate Service running with autoscaling (Targate Tracking CPU)
Why do I see the CloudWatch alarm in the "in alarm" state always for Low CPU utilization?
Is this because Target ...
- 467