Delete gcp bucket objects using s3 api

Question

My code to delete the objects look like this:


const s3 = new AWS.S3({
    endpoint: spaceEndpoint,
    accessKeyId,
    secretAccessKey,
})

const params = {
    Bucket: bucketName,
    Delete: {
        Objects: assetsToDelete,
    },
}
try {
    const res1 = await s3.deleteObjects(params).promise()
}catch(e){
    console.log(e)
}

value of assetsToDelete is

  {
    Key: 'userId/folderName/object1'
  },
  {
    Key: 'userId/folderName/object2'
  }
]

But I'm getting an error:

InvalidArgument: Invalid argument.
   ErrorSTACK {
  code: 'InvalidArgument',
  region: null,
  time: 2021-02-12T20:30:42.055Z,
  requestId: null,
  extendedRequestId: undefined,
  cfId: undefined,
  statusCode: 400,
  retryable: false,
  retryDelay: 81.1455003388468
}

The above configuration works fine for upload and listing objects. I'm trying to delete from a gcp bucket.

I don't think Google Cloud Storage supports this yet, but you can delete objects individually. issuetracker.google.com/issues/162653700 is tracking this. — Chris Wilcox
– Chris Wilcox, Commented Feb 12, 2021 at 21:30
Additionally, cloud.google.com/storage/docs/migrating#methods-comparison may be helpful in comparing the two surfaces and making calls. — Chris Wilcox
– Chris Wilcox, Commented Feb 12, 2021 at 21:35
@ChrisWilcox thank you for this. I used s3.deleteObject instead of s3.deleteObjects. — Vikas Kundu
– Vikas Kundu, Commented Feb 14, 2021 at 16:48
@ChrisWilcox I upvoted the comment that helped OP with the issue. Please post it as an answer. — Donnald Cucharo
– Donnald Cucharo, Commented Feb 17, 2021 at 1:03

Chris Wilcox · Accepted Answer · 2021-02-18 03:01:36Z

4

As of posting, Google Cloud Storage doesn't support Multi-object Delete.

That said, you can delete individual objects. If you would like to track the addition of this, you can view https://issuetracker.google.com/issues/162653700

Additionally, cloud.google.com/storage/docs/migrating#methods-comparison may be helpful in comparing the two surfaces and making calls as you continue on your migration from S3 to Google Cloud Storage

answered Feb 18, 2021 at 3:01

Chris Wilcox

3572 silver badges7 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

Delete gcp bucket objects using s3 api

1 Answer 1

Comments

Your Answer

Linked

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Linked

Related