Stay up to date
We'll highlight new content in your collectives with a blue activity indicator on navigation items and posts.
Manage preferences
Questions
Browse questions with relevant AWS tags
258,737 questions
0
votes
1
answer
48
views
AWS S3 SCP Policy to Prevent Disabling Public Access Block but Allow Re-enabling
I need to create an AWS IAM policy that prevents users from disabling the "Block all public access" configuration on S3 buckets, but still allows them to re-enable it if it was already ...
- 1,146
0
votes
1
answer
130
views
AWSSDK.S3 causes x-amz-content-sha256 error against minio
I'm using the AWSSDK.S3 for .NET (v4.0.9.1) in my app. For my tests I run minio in a docker container. I know this worked in the past but with an update to the current versions of the SDK and the ...
- 6,718
1
vote
0
answers
53
views
How to identify which IdP a user used to sign in during AWS Cognito PreAuthentication trigger?
How can I determine which Identity Provider (IdP) a user used to sign in during the AWS Cognito PreAuthentication trigger, when multiple federated IdPs (SAML/OIDC) are linked to the same user?
In the ...
- 11
0
votes
0
answers
34
views
Concurrency issue while updating micro-frontend manifest to s3
All MFEs are deployed using a single shared GitHub Actions workflow.
This workflow handles deployment for any MFE that has been updated and updates a shared manifest file that lists all deployed MFE ...
- 69
0
votes
1
answer
38
views
Unknown type FieldUnion for field fields. Did you forget to add the @model directive. Grapghql
getting below error during amplify publish .
Unknown type FieldUnion for field fields. Did you forget to add the @model directive
the code:
FieldUnion = KeyValueField | AnotherFieldType
type MyObject ...
- 303
0
votes
1
answer
69
views
Two negations in AWS rule
I have the following aws rule which runs a lambda for all events whose alarm-name does not start with “MyPrefix”.
new Rule(this, ‘myEventRule', {
eventPattern: {
detailType: ['CloudWatch ...
- 2,166
0
votes
1
answer
43
views
AWS Lambda inside VPC cannot connect to RDS MySQL (timeout)
Background
I'm building a Lambda function (Node.js 20 runtime) that connects to an Amazon RDS MySQL database within the same VPC.
Both the Lambda and the RDS instance are deployed in private subnets.
...
0
votes
1
answer
40
views
Can I create a kafka topic if I can't reach the controller?
I'm not exactly sure about this but is it possible to create a topic if say the the client that tries to create a topic is not able to reach the controller node of the Kafka cluster (due to some ...
- 344
1
vote
0
answers
51
views
Batch unprocessed items are actually processed
I'm implementing a solution with high throughput, 500 - 700 items per second per instance, and I'm using DynamoDB for persistence. For every item I performat least 2 writes and one read, some like:
...
- 501
0
votes
0
answers
110
views
Sudden CPU spike on AWS RDS (PostgreSQL) after running fine for the entire last month
I encountered an issue where our AWS RDS (PostgreSQL) instance suddenly experienced a high CPU spike, even though it had been running normally for the entire previous month.
Currently, the system is ...
- 13
0
votes
1
answer
55
views
Spark Structured streaming job failed in mid of day due to delta file not found in S3 checkpoint folder
I'm using spark version 3.4.4 and running spark structured streaming application.
Data pipeline reads data from kafka continuously and do some aggregations on stream data and stores the result into ...
- 1,171
0
votes
0
answers
42
views
Setup Google Tag Gateway with AmazonLoadBalancer
I have been tasked with setting up Google Tag Gateway for the website at work, and am struggling to understand how to get this done. We use rails backend and ALB and Route53 to route requests to our ...
- 188
1
vote
0
answers
51
views
Unable to complete Amplify v6 Cognito OAuth flow in my Next.js App
I am using Amplify and Cognito's hosted UI Login page to handle my user authentication. I am able to redirect to the cognito hosted page, enter my user credentials, and redirect page to my sign in ...
- 11
1
vote
0
answers
60
views
Is there an API to check for currently supported runtimes by AWS Lambda?
I’m developing a tool to speed up the AWS Lambda creation process for my colleagues and I, as we use it extensively, and I need to periodically check for deprecated runtimes. The idea is to create a ...
- 674
1
vote
1
answer
69
views
Lock a DynamoDB table on reading/writing operations
I have a DynamoDB table with entries that can have a status (waiting, error, running...). Only up to 25 entries can have running status.
My objective is to have an AWS Lambda function that checks if ...
- 3,082
-1
votes
0
answers
29
views
Expected X-Cache value when serving requests for non-existent files?
I have configured CloudFront and S3 using OAI and it generally serves files as expected.
I am trying to reduce my S3 API costs and I think about 10% of it is linked to requests for non-existent files. ...
- 4,892
0
votes
0
answers
61
views
AWS Code Deploy command not found for pm2 and pnpm
I'm deploying Node.js based server on EC2 via code deploy.
I'm using pnpm and pm2, when execution of shell script from appsepc.yml, it seems path not works. pnpm command not found or pm2 command not ...
- 355
0
votes
0
answers
74
views
AWS Bedrock Calling retrieve_and_generate from boto3 always returns "Sorry, I am unable to assist you with this request."
I am calling the retrieve_and_generate of the Bedrock API to do RAG on a set of documents. Given the following code, the generative model consistently returns:
"Sorry, I am unable to assist you ...
- 1,972
2
votes
1
answer
55
views
What is the best way to check the file size in S3 multipart upload?
I would like to set a file size limit in uploads through multipart upload in my application, but my problem is, using pre-signed-url, I can't check the file size of each part and all the options I ...
- 21
1
vote
1
answer
64
views
PSQLException: ERROR: buffer is pinned in InvalidateBuffer on CREATE DATABASE command
Working with Amazon RDS - PostgreSQL 16, my Java application started receiving the following error when trying to run the CREATE DATABASE command
Caused by: org.postgresql.util.PSQLException: ERROR: ...
- 2,218
0
votes
1
answer
39
views
qbo3 Textract ScoreEngine Not Finding Results
I am using qbo to extract data from a document using scoring, using a CompositeEngine that composes results from an AiScoreEngine (for LLM analysis) and a TextractEngine (leveraging AWS Textract's PDF ...
- 2,307
0
votes
0
answers
83
views
How to Check if a Query Touches Data Files or just Uses Manifests and Metadata in Iceberg
I created a table as follows:
CREATE TABLE IF NOT EXISTS raw_data.civ (
date timestamp,
marketplace_id int,
... some more columns
)
USING ICEBERG
PARTITIONED BY (
marketplace_id,
...
- 2,781
1
vote
0
answers
66
views
Polars LazyFrame sink_parquet + PartitionByKey slower to S3 than local disk
I'm wondering why I'm seeing such poor performance when writing a LazyFrame using PartitionByKey to S3 when compared to other methods. Here is a simple test script that writes out some random data to ...
- 266
1
vote
0
answers
35
views
NiFi ListS3 Processor SdkClientException: Name or service not known for S3 bucket
I'm setting up an Apache NiFi flow using the ListS3 processor to scan an AWS S3 bucket, but I keep getting errors, and the processor isn't listing any files from the bucket.
NiFi Processor ...
- 61
0
votes
0
answers
57
views
Inconsistent NLU for ToggleController friendlyNames
We’re building an Alexa Smart Home Skill for OmniBreeze tower fans (model DC2313R-G). Both devices are discovered with identical capabilities, including a ToggleController for oscillation using ...
- 1
1
vote
1
answer
62
views
aws_secretsmanager: Secret Value is not correct. How does this work?
I want to create a new secret via cdk. It seems that I don't understand it...
Python code:
foo = secretsmanager.Secret(
self,
"foo",
generate_secret_string=...
- 522
0
votes
0
answers
52
views
AWS ALB - Entra OIDC - Access Token - Custom API Scopes Issue
The request flow for my setup is that first, the requests go to AWS ALB, then authentication will be done by Entra at ALB level and then if auth is successful, then the request with tokens set as ...
1
vote
0
answers
84
views
Clojure problems in resolving .local server address inside private network
First of all thanks in advance for any help, this is the first time I'm setting up a system like this, so a few points are not clear and might be written in bad form (and that's why I'm here).
...
- 31.8k
0
votes
1
answer
61
views
NextAuth Google Login Redirect to Localhost instead of Production Domain
I am doing a project which will use Google Login in NextJs
This is my setting in OAuth 2.0
and in amplify environment variables
After I deployed the app and try to login
It redirect me to http://...
- 124
0
votes
0
answers
56
views
Pyiceberg - S3tables and boto3 session
In Pyiceberg 0.10.0, it is now possible to use a botocore session for a rest catalog, so:
import io
import os
import pandas as pd
import pyarrow as pa
from boto3 import Session
from pyiceberg....
- 485
0
votes
1
answer
33
views
npm drizzle-kit and AWS RDS: Error: getaddrinfo EAI_AGAIN
I don't seem to be able to push my configuration to RDS
// package.json
"drizzle-kit": "^0.31.5",
// drizzle.config.ts
import { defineConfig, Config } from 'drizzle-kit';
const ...
- 320
0
votes
1
answer
46
views
AWS CloudWatch -> Firehose/Lambda -> Splunk flow -- lambda response too large
Given a CloudWatch -> Firehose -> Splunk flow, where Firehose passes incoming log records to a lambda, often the return from the lambda is larger than the allowed 6MB.
I've captured the payload ...
- 28k
0
votes
1
answer
43
views
AWS CodeDeploy Authentication Error with GitHub Account
I am trying to connect my personal GitHub account to AWS CodeDeploy so I can use that as a revision source.
I've followed this guide on setting this up.
When it comes to the actual integration with ...
-1
votes
1
answer
78
views
(Amplify Gen 2) Bedrock AI Generation Produces ValidationException (Mapping Error)
I'm following the AWS Amplify Gen 2 documentation here: https://docs.amplify.aws/react-native/ai/generation/ exactly as it is written. Our ./amplify/data/resource.ts looks like this:
const schema = a....
- 11
1
vote
0
answers
62
views
Why does botocore raise ValidationException with pydantic BaseModel output constraint on variable length output types?
I am using pydantic AI and use pydantic BaseModel to set the output_type of the answer. From time to time I encounter a ValidationException. I cannot accurately pinpoint the issue creating this ...
- 117
0
votes
0
answers
44
views
Not able to send sms using AWS End User Messaging
Below are india Specific In fo , we filled in Sender Id Registration in AWS EUM. We got apporval from Kqarix Mobile, and for rest of TE we filled 00000000000000000000 as it wan bot accepting NA or &...
- 3,237
1
vote
1
answer
49
views
Redshift : Opening multiple cursors from within the same client connection is not allowed
I have the following procedure written in redshift, which uses 2 for loops to get country code first and then years as per the country codes.
--Procedure : sp_for_loop_test
create or replace procedure ...
- 7,345
0
votes
0
answers
60
views
API Gateway not forwarding real path to Lambda
I have a Lambda (Go) behind an HTTP API Gateway.
Route /webhook is set correctly (payload format 2.0, not $default), but every request to /webhook still triggers my root / handler, im not getting the ...
0
votes
0
answers
57
views
aws ec2 ubuntu : why a command works with terminal BUT not with user_data?
i lanched an ec2 instance (ubuntu), and i have a script which looks like :
#!/bin/bash
# works fine (even directly in terminal or via user_data)
hostnamectl set-hostname ${hostname}
# works fine as ...
- 273
0
votes
0
answers
66
views
Unexpected Write Behavior when using MERGE INTO/INSERT INTO Iceberg Spark Queries
I am observing different write behaviors when executing queries on EMR Notebook (correct behavior) vs when using spark-submit to submit a spark application to EMR Cluster (incorrect behavior).
When I ...
- 2,781
1
vote
0
answers
36
views
Frequent RedisTimeoutException in .NET 9 running on Linux containers with Redis on AWS (v7.0.7)
I am frequently encountering RedisTimeoutException errors in my application. The application is built using .NET 9 and runs in Linux-based containers. Redis is hosted on AWS Elastic Cache with version ...
1
vote
0
answers
40
views
Logging username that generates GET/PUT pre-signed url for audit in s3 boto
trying to log the username that generates a presigned url for 'GET' method for auditing.
Need the info to be available server-side.
What I've tried:
Concat the username to the url '&', this wont ...
- 21
0
votes
0
answers
42
views
FastAPI: PDF upload works when called directly inside Kubernetes or locally, but results in blank files when routed through API Gateway/NGINX
I’m running a FastAPI service in Kubernetes that accepts multipart/form-data uploads and stores files in S3.
The upload endpoint works fine when I call it directly inside the cluster using the service ...
- 3
0
votes
1
answer
85
views
Spring Boot OAuth2 with Casdoor behind AWS Lambda + HTTP API v2: state parameter encoding issue
I’m developing a Spring Boot application deployed behind an AWS API Gateway (HTTP API v2) with Lambda (handler based on SpringBootLambdaContainerHandler and HttpApiV2ProxyRequest).
I’m using OAuth2 ...
- 11
0
votes
0
answers
63
views
Linker error when importing AWS libraries in Unreal Engine
I am trying to get users to be able to log in via a Cognito account and use those credentials to make calls on a backend API. To that end I have been trying to import the Cognito libraries in an ...
0
votes
0
answers
49
views
AWS Lex + Lambda + API Gateway integration — request stuck on “Thinking…” and Lambda not triggered
I’ve built a simple web-based chatbot (called Engineer’s Toolkit) that uses Amazon Lex, AWS Lambda, and API Gateway, with a static frontend hosted on S3.
The flow is supposed to be:
Frontend (S3) → ...
0
votes
0
answers
127
views
Why am I getting "Invalid initialization vector" when calling my signed URL upload API in Node.js?
I’m working on a Node.js backend that generates a signed URL for uploading files to AWS S3 via CloudFront.
However, when I hit the signed URL endpoint from curl, I always get the following response:
{&...
0
votes
0
answers
50
views
Can't get AWS Lambda Powertools dynamic routes to work
from aws_lambda_powertools.utilities.typing import LambdaContext
from aws_lambda_powertools.event_handler import APIGatewayHttpResolver
from aws_lambda_powertools.logging import Logger
from validate ...
0
votes
1
answer
72
views
trouble connecting my database to Django server on deployment machine
I'm deploying to AWS Linux 2023 and my postgresql database in on aws RDS. I've installed psql and checked if db is accessible in my instance. I've also checked that the environmental variables are ...
0
votes
1
answer
27
views
AWS Lambda not triggering on S3 ObjectCreated:Put after code edit. What am I missing?
I have an S3 bucket that should invoke a Lambda function on ObjectCreated:Put. This used to work. After editing the Lambda code in the console, new uploads stopped triggering the function. I do not ...
- 1
Michael Wiles
scored 10
asking questions this week
+10
Members can contribute articles
Simply submit a proposal, get it approved, and publish it.
See how the process works
Simply submit a proposal, get it approved, and publish it.
See how the process works