How to ignore duplicates records of a large table when using Copy Binary in postgres

Question

I am trying to do bulk insert data in postgres using Binary copy, as below

await connection.BeginBinaryImportAsync($"COPY ph_numbers FROM STDIN (FORMAT BINARY));

This table already contains millions of records and I just want to ignore the records already present there.

I went through the documentation and could not find any efficient way to ignore duplicates.

Laurenz Albe · Accepted Answer · 2023-07-14 12:08:02Z

3

There is no way to ignore duplicates.

You can COPY the data to a temporary table and then use INSERT ... SELECT ... ON CONFLICT ... DO NOTHING to merge the data into your existing table.

answered Jul 14, 2023 at 12:08

Laurenz Albe

257k22 gold badges312 silver badges388 bronze badges

Sign up to request clarification or add additional context in comments.

Collectives™ on Stack Overflow

How to ignore duplicates records of a large table when using Copy Binary in postgres

1 Answer 1

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

1 Answer 1

Comments

Your Answer

Sign up or log in

Post as a guest

Related