Understanding postgres explain w/ bitmap heap/index scans

Question

I have a table w/ 4.5 million rows. There is no primary key. The table has a column p_id, type integer. There's an index, idx_mytable_p_id on this column using the btree method. I do:

SELECT * FROM mytable WHERE p_id = 123456;

I run an explain on this and see the following output:

Bitmap Heap Scan on mytable  (cost=12.04..1632.35 rows=425 width=321)
  Recheck Cond: (p_id = 543094)
  ->  Bitmap Index Scan on idx_mytable_p_id  (cost=0.00..11.93 rows=425 width=0)
        Index Cond: (p_id = 543094)

Questions:

Why is that query doing a heap scan and then a bitmap index scan?
Why is it examining 425 rows? Why is the width of the operation 321?
What is the cost of 12.04..1632.35 and 0.00..11.93 telling me?

For the record there are 773 rows with the p_id value of 123456. There are 38 columns on mytable.

Thanks!

Kevin Christopher Henry · Accepted Answer · 2014-10-18 07:20:10Z

58

Why is that query doing a heap scan and then a bitmap index scan?

It's not, exactly. EXPLAIN output shows the structure of the execution nodes, with the ones on the "higher" level (not indented as far) pulling rows from the nodes below them. So when the Bitmap Heap Scan node goes to pull its first row the Bitmap Index Scan runs to determine the set of rows to be used, and passes information on the first row to the heap scan. The index scan passes the index to determine which rows need to be read, and the heap scan actually reads them. The idea is that by reading the heap from beginning to end rather than in index order it will do less random access -- all matching rows from a given page will be read when that page is loaded, and enough pages may be read in order to use cheaper sequential access rather than seeking back and forth all over the disk.

Why is it examining 425 rows?

It's not. You ran EXPLAIN, which just shows you estimates and the chosen plan, it doesn't really examine the rows at all. That makes the value of EXPLAIN rather limited compared to running EXPLAIN ANALYZE, which actually runs the query and shows you the estimates and the actual numbers.

Why is the width of the operation 321?

Apparently that's the size, in bytes, of the tuples in mytable.

What is the cost of 12.04..1632.35 and 0.00..11.93 telling me?

The first number is the cost to return the first row from that node; the second number is the cost to return all of the rows for that node. Remember, these are estimates. The unit is an abstract cost unit. The absolute number means nothing; what matters in planning is which plan has the lowest cost. If you are using a cursor the first number matters; otherwise it is usually the second number. (I think it interpolates for a LIMIT clause.)

It is often necessary to adjust configurable cost factors, such as random_page_cost and cpu_tuple_cost, to accurately model the costs within your environment. Without such adjustments the comparative costs are likely to not match the corresponding run times, so a less-than-optimal plan might be chosen.

edited Oct 18, 2014 at 7:20

Kevin Christopher Henry

49.7k8 gold badges125 silver badges111 bronze badges

answered Apr 13, 2012 at 17:51

kgrittn

19.8k4 gold badges41 silver badges47 bronze badges

Sign up to request clarification or add additional context in comments.

2 Comments

vyegorov Over a year ago

The total cost of the inner operation will be always included in the startup cost of the outer operation.

kgrittn Over a year ago

@vyegorov is right, with the caveat that for actual data from EXPLAIN ANALYZE you should understand that the total time taken by the node is divided by loops to show the time per iteration. As you would expect, it is the total time for the node which included in the enclosing nodes.

user330315 · Accepted Answer · 2012-04-13 17:43:32Z

re 1) execution plans have to be read from the inner most node to the outermost node. So it's first doing an index scan (to find the rows) and the accessing the actual table to return the rows the index scan found

re 2) the number of rows shown in the plan is just an estimation based on the statistics and as such 425 vs. 773 sounds fairly reasonable. If you want to see real figures, use explain analyze

re 3) the first number in the cost figure is the "startup" cost to intialize the step of the planner, the second cost is the total cost of that step.

This is all documented in the manual: http://www.postgresql.org/docs/current/static/using-explain.html

You might want to go through these links in the PostgreSQL Wiki as well:

PostgreSQL EXPLAIN
Using Explain

Collectives™ on Stack Overflow

Understanding postgres explain w/ bitmap heap/index scans

2 Answers 2

2 Comments

Comments

Your Answer

Hot Network Questions

Collectives™ on Stack Overflow

2 Answers 2

2 Comments

Comments

Your Answer

Sign up or log in

Post as a guest

Related