patternsqlMinor
PostgreSQL unique continue on violation
Viewed 0 times
postgresqluniquecontinueviolation
Problem
I am creating ETL where I rely on the database to refuse duplicate values for a business key. In SQL Server this works like a charm. The database gives an error, the ETL ignores the error, continues and the next row gets inserted just fine. With PostgreSQL my UNIQUE constraint (or index, they show the same behaviour) blocks any further inserts. This makes this solution useless and PostgreSQL a less useful candidate for the datavault I'm creating for my client.
I find a solution with using a rule, but this turns out to be extremely slow. The performance is multiple times worse. This makes using a rule also no good way to have the database deal with doubles.
Is there any way to have PostgreSQL keep on inserting new rows after a UNIQUE constraint violation?
I find a solution with using a rule, but this turns out to be extremely slow. The performance is multiple times worse. This makes using a rule also no good way to have the database deal with doubles.
Is there any way to have PostgreSQL keep on inserting new rows after a UNIQUE constraint violation?
Solution
Check PostgreSQL documentation for detailed syntax for INSERT statement.
In particular, there's an optional
where
and
In your case, you probably want to append at the end of your INSERT statement:
and the conflicts will be skipped, and further inserts will continue.
This answer is based on @Akina's comment. Thanks!
In particular, there's an optional
ON CONFLICT part:ON CONFLICT [ conflict_target ] conflict_actionwhere
conflict_target can be one of:( { index_column_name | ( index_expression ) } [ COLLATE collation ] [ opclass ] [, ...] )
[ WHERE index_predicate ]
ON CONSTRAINT constraint_nameand
conflict_action is one of:DO NOTHING
DO UPDATE SET { column_name = { expression | DEFAULT } |
( column_name [, ...] ) = ( { expression | DEFAULT } [, ...] ) |
( column_name [, ...] ) = ( sub-SELECT )
} [, ...]
[ WHERE condition ]In your case, you probably want to append at the end of your INSERT statement:
ON CONFLICT DO NOTHINGand the conflicts will be skipped, and further inserts will continue.
This answer is based on @Akina's comment. Thanks!
Code Snippets
ON CONFLICT [ conflict_target ] conflict_action( { index_column_name | ( index_expression ) } [ COLLATE collation ] [ opclass ] [, ...] )
[ WHERE index_predicate ]
ON CONSTRAINT constraint_nameDO NOTHING
DO UPDATE SET { column_name = { expression | DEFAULT } |
( column_name [, ...] ) = ( { expression | DEFAULT } [, ...] ) |
( column_name [, ...] ) = ( sub-SELECT )
} [, ...]
[ WHERE condition ]ON CONFLICT DO NOTHINGContext
StackExchange Database Administrators Q#232110, answer score: 2
Revisions (0)
No revisions yet.