I know in SQL we can compress the text field like the following:
CREATE TABLE TableName (FieldName CHARACTER(255) WITH COMPRESSION);
I want to know how to achieve the text compression in Postgres.
-
For store the compressed string, see also stackoverflow.com/q/2958073/287948Peter Krauss– Peter Krauss2012-05-07 10:32:05 +00:00Commented May 7, 2012 at 10:32
Add a comment
|
1 Answer
Compression is enabled by default for all string types, you don't have to tell the database to do it. Check the manual about TOAST
- PLAIN prevents either compression or out-of-line storage; furthermore it disables use of single-byte headers for varlena types. This is the only possible strategy for columns of non-TOAST-able data types.
- EXTENDED allows both compression and out-of-line storage. This is the default for most TOAST-able data types. Compression will be attempted first, then out-of-line storage if the row is still too big.
- EXTERNAL allows out-of-line storage but not compression. Use of EXTERNAL will make substring operations on wide text and bytea columns faster (at the penalty of increased storage space) because these operations are optimized to fetch only the required parts of the out-of-line value when it is not compressed.
- MAIN allows compression but not out-of-line storage. (Actually, out-of-line storage will still be performed for such columns, but only as a last resort when there is no other way to make the row small enough to fit on a page.)
6 Comments
Frank Farmer
From the docs, it looks like TOAST compression is only active for values greater larger than 2kb. The OP's example wouldn't hit the 2k threshold, and thus won't be compressed.
Frank Heikens
You can enforce compression, depends on storage parameters: postgresql.org/docs/current/interactive/storage-toast.html
Frank Farmer
By changing TOAST_TUPLE_THRESHOLD ? I think that requires a recompile?
Frank Farmer
SET STORAGE is effectively a noop for rows smaller than 2k though, right? "The TOAST code is triggered only when a row value to be stored in a table is wider than TOAST_TUPLE_THRESHOLD bytes (normally 2 kB)"
rogerdpack
It appears to me, from the docs, that if a row is > 2KB and any of its columns are TOAST-able then TOAST will try and compress, then store out of band, TOAST-able columns until it reaches TOAST_TUPLE_TARGET for the row. So recompiling with different parameters would be the only way to force compression for < 2KB rows.
|