Stay up to date
We'll highlight new content in your collectives with a blue activity indicator on navigation items and posts.
Manage preferences
Questions
Browse questions with relevant AWS tags
258,737 questions
-3
votes
0
answers
24
views
AWS Account Replication [closed]
Have anybody replicated an AWS Account to a new account? I have a requirement where I need to fully replicated resources from one production AWS Account to a new one if someone could help me out would ...
- 1
0
votes
0
answers
53
views
Spring Boot app using AWS Parameter Store does not reflect updated values even after container restart (requires redeployment)
I have a Spring Boot application running in a container.
I configured AWS Parameter Store integration using:
/application/env/version/1.0/SPRING_CONFIG_IMPORT = aws:parameterstore:/application/env/...
- 43
Advice
0
votes
0
replies
19
views
Applying a Single AWS Glue Data Quality Ruleset to Multiple Glue Jobs with Dynamic Column Input
Team,
We are implementing a new requirement to integrate Data Quality (DQ) rules within AWS Glue Studio. We have successfully created DQ rules using the DQDL builder, leveraging built-in rulesets, and ...
- 15
Best practices
0
votes
0
replies
40
views
How to run tests with CDK pipelines
We are building and deploying a few system using the AWS CDK Pipeline, mostly with dotnet
Most cases we are building the deployed apps using dockerfile assets referenced in the CDK
Should we run the ...
- 628
Tooling
0
votes
0
replies
70
views
R (R Studio) on AWS - Louis A. AMIs
It has been a while since I last used R AMIs (since about Fall of 2023) from here: https://www.louisaslett.com/RStudio_AMI/. Previously, when I clicked on any one of the AMI links, my AWS page would ...
- 519
-3
votes
1
answer
102
views
+50
Flink Job Manager Direct Buffer Memory gets exhausted when checkpointing enabled
Issue:
Flink application throws Thread 'jobmanager-io-thread-25' produced an uncaught exception. java.lang.OutOfMemoryError: Direct buffer memory and terminates after running for 2-3 days.
No matter ...
- 1,514
-1
votes
0
answers
22
views
What is the recommended processes to update assets and properties in AWS IoT SiteWise in a bulk mode? [closed]
I have a project in aws sitewise that contains some thousands of assets and properties.
I want to update some hundreds of properties in different assets, for example I want to make them to allow to ...
- 5,578
Advice
0
votes
1
replies
34
views
Query S3 from Athena without a table
Is there a way to query data from a S3 bucket through Athena without creating a table?
Something like this:
with
table1 as (select * from real_table),
table2 as (create table from s3 location)...
- 782
1
vote
1
answer
78
views
How do I get bucket name when I have S3Object instance?
In AWS SDK v1, we could use the getBucketName() method from S3ObjectSummary to retrieve the bucket name. However, in AWS SDK v2, the S3Object class doesn’t seem to provide a similar method.
How can I ...
- 19
Advice
2
votes
5
replies
74
views
Building Privacy-Compliant LLM Apps (e.g. Section 203 StGB)
I’m working on an app that leverages Large Language Models (LLMs) to assist professionals in regulated fields like medicine and law. My main concern is ensuring compliance with privacy and secrecy ...
- 3,541
0
votes
1
answer
54
views
I have a working AWS Appsync application that uses OPENID_CONNECT as authorization, when I added API_KEY as additional broke the old routes
I have a working AWS Appsync application that uses OPENID_CONNECT as authorization, when I added API_KEY as additional broke the old routes. For some reason in the appsync schema it had in all routes ...
Advice
1
vote
2
replies
71
views
AWS How to identify/recommend the instance type for an RDS?
I am currently working on recommendation for aws rds instance type recommendation. We have identified the instances which are underutilised.
I want to know how to recommend a better version of rds ...
- 29
1
vote
2
answers
79
views
AWS CloudFormation deploy template stored in an S3 bucket [closed]
Trying to deploy a CloudFormation template that is stored in an S3 bucket as the template size is larger than 51kb so cant be done direct (from what I am led to believe and have seen when trying)
...
- 1,091
0
votes
1
answer
68
views
AWS Cognito Google Sign-in with Next.js works, but Sign-out does not fully log the user out
I’m using AWS Cognito with Google as an Identity Provider in a Next.js app. I am using AWS managed login as well. Sign-in works correctly, tokens are received, and the user session persists. However, ...
- 900
0
votes
0
answers
22
views
Submit false positive email to Bitdefender using API and Tray.io
Backgreound:
I am trying to create a workflow using tray.io to list emails in an S3 bucket and send them one by one to Bit Defender to report them as false positives.
Everything is working except the ...
- 400
-3
votes
1
answer
67
views
How to Run many script python with low memory in EC2? [closed]
I have many python script that run in schedule (its crawlers). currently i'm using tmux to automate the script running in my ec2 instance. but since the number of scripts are growing, its getting ...
- 11
-1
votes
0
answers
62
views
AWS API Gateway HTTP API v2 removes padding (`=`) from query parameters when calling Lambda (Java Spring Boot)
I’m using AWS API Gateway HTTP API v2 with a Lambda function running a Java Spring Boot application
The integration type is Lambda proxy integration with payloadFormatVersion: 2.0.
Everything works ...
- 11
-2
votes
0
answers
37
views
Stuck with django asgi server (dpahne) and aws eb (with docker) [closed]
I’m trying to deploy a Django application that uses Channels + ASGI + Daphne on AWS Elastic Beanstalk with the Docker platform. My container builds successfully, migrations run, and Daphne starts ...
-3
votes
0
answers
77
views
How to use the built-in request validators instead of creating new resource?
In order to enforce query params validation, we have to assign Request validator in the method request. In my case I want to enforce required validation to startDate and endDate query params (Validate ...
- 2,974
Best practices
0
votes
2
replies
62
views
Best way to structure solution on AWS
Let's say there's a VM on AWS that is being used to host multiple instances of the same web app.
The web app has a React front end and an ASP.NET Core backend, and the VM runs IIS.
Each instance of ...
- 535
0
votes
0
answers
53
views
AWS CDK use api gateway in a nested stack
I have this api gateway in my main stack:
api_gateway = _api_gw.LambdaRestApi(
self,
f"{construct_id}-gw-api",
handler=lambda_hello,
rest_api_name=f"gw-api{env_ext}"...
- 43
0
votes
0
answers
55
views
Integrating R functions in Python AWS Bedrock agents
I have the following Python code and I was just curious how I can use the rpy2 package to import some R functions such that Bedrocks Agent() can have access to them. (I know I could just write a Sys....
- 7,189
0
votes
0
answers
37
views
Application running in Docker containers the application restarted using Amazon RDS Aurora MySQL for the database and experiencing out-of-memory issue
UncaughtException: Out of memory; check if mysqld or some other process uses all available memory; if not, you may have to use 'ulimit' to allow mysqld to use more memory or you can add more swap ...
-1
votes
1
answer
65
views
Intermittent 500 Internal Server Error in AWS Lambda API (Different endpoints fail randomly)
I’m facing an issue with my React frontend and AWS Lambda backend setup.
When my app makes multiple API calls at the same time, some of them randomly return a 500 Internal Server Error, while others ...
- 142
Tooling
0
votes
0
replies
21
views
Open resty kubernetes frontend
User-->Load abalancer-Frontend VPC-Openresty Nginx --->Router-->Priv LB -->Kubernetes
I want to ask about Openresty in Kubernetes. I am using it now as reverse Proxy as Tasks in AWS and ...
- 11
Best practices
0
votes
1
replies
50
views
How to deploy an Angular SSR app using AWS?
As I searched online many times but didn't find a satisfying answer, I'm asking my question here.
I have an Angular app (version 20) that uses SSR and I would like to deploy it using AWS. I know how ...
- 767
-4
votes
1
answer
63
views
AWS Lambda Python script calling SageMaker: AlgorithmError: Framework Error
I am using lambda and Python and S3.
# lambda_bootstrap_train.py
import boto3
import time
import json
import os
sm = boto3.client('sagemaker', region_name='us-east-2')
s3 = boto3.client('s3', ...
- 688
0
votes
0
answers
64
views
AWS SDK C# - 'Access denied to head index' error during Creation of a vector index for a collection
I have been trying to create index for an AWS Open Search Serverless collection, which I am using to create a knowledge base. Collection and policy get created. But during index creation I keep ...
- 29
0
votes
1
answer
36
views
Limiting cardinality of predicates in SPARQL queries
I'm trying to create a query to match what we call the "shape" of a node in our rdf data. One of the things that goes into this shape is a cardinality for each type of predicate that can ...
- 3
0
votes
1
answer
240
views
Migrate Elasticsearch code to OpenSearch multi request search [closed]
I have this code:
import org.elasticsearch.ElasticsearchException;
import org.elasticsearch.action.ActionListener;
import org.elasticsearch.action.DocWriteResponse.Result;
import org.elasticsearch....
- 1,074
0
votes
0
answers
56
views
Which exceptions are able to be thrown by S3 in the .NET SDK?
I'm used to Microsoft's documentation which states clearly which Exceptions a method can throw, e.g. File.Move. The Official API Docs for GetObjectAsync don't mention anything about exceptions. I know ...
- 1,151
-1
votes
0
answers
30
views
Why are all versions of Lambda@Edge function being modified when I deploy the latest code?
I have a Lambda@Edge function which has 2 versions. Version 1 has non-functional code and version 2 has the latest operational code. What that function does is it fetches an object from an S3 bucket ...
- 459
0
votes
1
answer
45
views
"SMTPAuthenticationError: Authentication disabled due to threshold limitation" on production server on AWS
I've set-up email sending in my Django project that is deployed on AWS. When I run it locally the emails go out without a problem, but when I try it on production server on EC2 ubuntu VM, I get ...
- 491
1
vote
0
answers
93
views
How do I find out what's causing these valkey AWS Elasticache requests to timeout?
We have sporadic, but repeatable, timeout issues with valkey at higher loads that we haven't been able to diagnose the root cause of. We're using StackExchange.Redis on the old school .NET Framework 4....
- 1,101
0
votes
0
answers
27
views
Client of Amplify Gen 2 is not being properly generated for subscription
Logging const client = generateClient<Schema>(); results in the following, which shows that the client is improperly generated:
{
"models": {},
"enums": {},
"...
- 4,103
0
votes
1
answer
61
views
How to do bucket logic in partition for Iceberg Table using AWS Glue?
# =====================================================
# 🧊 Step 4. Write Data to Iceberg Table (Glue Catalog)
# =====================================================
table_name = "glue_catalog....
-1
votes
0
answers
23
views
Occasional “NoSuchKey” from S3 right after successful PUT using pre-signed URL (same region)
I’m facing an intermittent issue when uploading files to Amazon S3 from an Android app using a pre-signed PUT URL.
Setup:
Android app uploads directly to S3 via a pre-signed PUT URL.
After receiving ...
1
vote
1
answer
61
views
Apache returns 404 only when accessed through CloudFront (works fine via ELB directly)
Our web service is running on EC2 with Apache. We have the following setup:
Service A -> ELB -> Service B API
In this case, Apache on Service B shows in rewrite.log that the rewrite rule was ...
- 13
0
votes
0
answers
47
views
How to force refresh of AWS SSO loging "refresh"?
I use metaflow with S3. In order to access S3, I need to login with AWS CLI single sign on (aws sso login). The problem is that I have no way to force "refresh" (not sure about correct ...
- 1,559
-1
votes
1
answer
64
views
I tried to make an aws IAM user to see S3 buckets with certain tags
Here is the IAM policy (Mostly by chatgpt) :
{
"Version": "2012-10-17",
"Statement": [
{
"Sid": "AllowListAllBucketsForConsole&...
- 11
-1
votes
0
answers
59
views
How get data from Amazon WorkDocs into the AWS S3 bucket?
I need to automate the process of moving files from Amazon WorkDocs to an S3 bucket.
Here’s what I want to achieve:
Periodically fetch files from a specific WorkDocs folder.
Upload or sync them to ...
Advice
0
votes
1
replies
29
views
How to identify if a table has a header when extracted from Textract
I'm extracting tables from financial statement PDFs (like 10-Ks)
Textract has a feature which allows for extracting them in markdown format.
However, some of the tables don't have headers.
For example:...
1
vote
1
answer
85
views
Awswrangler: Parquet read into multiple of expected space
In a Lambda, I'm using AWS Wrangler to read data out of a date partitioned set of parquets and concatenate them together. I am doing this by calling wr.s3.read_parquet in a loop, compiling the loaded ...
- 80
3
votes
0
answers
87
views
How to convert epoch to datetime in Datadog dashboard?
I have a Datadog dashboard displaying the metrics we get for our AWS Glue Zero-ETL integrations. One of those is lastSyncTimestamp, the epoch timestamp until which source has been synced to target.
I ...
- 31
-1
votes
0
answers
65
views
Spring boot reading parameters from AWS parameter store without credentials on application.yml
I'm attempting to read a parameter from aws parameter store in my spring boot application.
I succeeded on my local machine but I want to make this function without having to supply my access-key and ...
0
votes
1
answer
176
views
How do I list the downloadable files using R for this NOAA website data source?
I want to download the tar.gz files from this NOAA (NCEI) data source:
https://www.ncei.noaa.gov/oa/local-climatological-data/index.html#v2/archive/
Normally, I can do something like this to get the ...
- 1,214
2
votes
0
answers
54
views
How should the knowledge base search operation be handled within an AWS Bedrock Agent custom orchestration Lambda?
According to the official AWS Bedrock Agent documentation, I can write a Lambda function to perform custom orchestration, also known as the ReWoo approach, in order to reduce the number of FM (...
- 21
1
vote
1
answer
62
views
Unable to pass Docker image to run to Ray Job Submit
I pulled this image - rayproject/ray:2.51.0.801bd7-extra-py310 from dockerhub with podman (ray prefers podman internally).
On AWS-EC2 then I started a head instance with - Deep Learning Base AMI with ...
- 33
1
vote
0
answers
49
views
Django Celery Beat SQS slow scheduling
Beat seems to be sending the messages into SQS very slowly, about 100/minute.
Every Sunday I have a sendout to about 16k users, and they're all booked for 6.30pm. Beat starts picking it up at the ...
- 11
1
vote
1
answer
44
views
How to troubleshoot OpenSearch upgrade eligibility failure
I'm trying to migrate an OpenSearch 2.9 cluster to OpenSearch 3.1 but the eligibility test informs the following message:
The following indices are not compatible with the target Elasticsearch ...
- 157
Michael Wiles
scored 10
asking questions this week
+10
Members can contribute articles
Simply submit a proposal, get it approved, and publish it.
See how the process works
Simply submit a proposal, get it approved, and publish it.
See how the process works