Ground Breakers Romania: Explain the explain_plan

2
Maria Colgan
Master Product Manager
Oracle Database
October 18, 2019
Explain the Explain Plan
INTERPRETING EXECUTION PLANS FOR SQL STATEMENTS

Safe harbor statement
The following is intended to outline our general product direction. It is intended for information purposes
only, and may not be incorporated into any contract. It is not a commitment to deliver any material,
code, or functionality, and should not be relied upon in making purchasing decisions.
The development, release, timing, and pricing of any features or functionality described for Oracle’s
products may change and remains at the sole discretion of Oracle Corporation.
3 Confidential – © 2019 Oracle Internal/Restricted/Highly Restricted

What is an execution plan
Program Agenda
1
2
3
4
How to generate a plan
4
Understanding execution plans
Execution Plan Example

Program Agenda
1
2
3
4
5

What is an execution plan?
Query:
SELECT prod_category, avg(amount_sold)
FROM sales s, products p
WHERE p.prod_id = s.prod_id
GROUP BY prod_category;
HASH JOIN
TABLE
ACCESS
SALES
Tree-shaped representation of
plan
TABLE
ACCESS
PRODUCTS
GROUP BY
Tabular representation of plan

Additional information under the execution plan
Access predicate
• Where clause predicate used
for data retrieval
• The start and stop keys for an index
• If rowids are passed to a table scan

Filter predicate
Where clause predicate that
not used for data retrieval but
to eliminate uninteresting row
once the data is found

Note Section
Details on Optimizer
features used such as:
Rule Based Optimizer (RBO)
Dynamic Sampling
Outlines
SQL Profiles or plan baselines
Adaptive Plans
Hints (Starting in 19c)

Program Agenda
1
2
3
4
10

Autotrace SQL Monitor
11
SQL Developer TKPROF
Many ways to view an execution plan
…..But there are actually only 2 ways to generate one

How to generate an execution plan
1.EXPLAIN PLAN command
Displays an execution plan for a SQL statement without actually executing the
statement
2.V$SQL_PLAN
A dictionary view introduced in Oracle 9i that shows the execution plan for a SQL
statement that has been compiled into a cursor in the cursor cache
Two methods for looking at the execution plan
Under certain conditions the plan shown with EXPLAIN PLAN
can be different from the plan shown using V$SQL_PLAN

SQL> EXPLAIN PLAN FOR
SELECT p.prod_name, avg(s.amount_sold)
GROUP BY p.prod_name;
SQL> SELECT * FROM
table(dbms_xplan.display('plan_table',null,'basic'));
EXPLAIN PLAN command & dbms_xplan.display function
PLAN TABLE
NAME
STATEMENT
ID
FORMAT

SQL> SELECT p.prod_name, avg(s.amount_sold)
GROUP BY p.prod_name;
SQL> SELECT * FROM
table(dbms_xplan.display_cursor(null, null, 'basic'));
Generate & display plan for last SQL statements executed in session
SQL_ID CHILD
NUMBER
FORMAT
• Format* is highly customizable - Basic ,Typical, All
– Additional low level parameters show more detail
*More information on formatting on Optimizer blog

Program Agenda
1
2
3
4
• Cardinality
• Access paths
• Join methods
• Join order
15

Cardinality
What is it?
Estimate of number rows that will be returned by each operation
Why should you care?
It influences everything! Access method, Join type, Join Order etc.
How does the Optimizer Determine it?
Cardinality for a single column equality predicate = total num of rows
num of distinct values
For example: A table has 100 rows, a column has 5 distinct values =>
cardinality=20 rows
More complicated predicates have more complicated cardinality calculation

Identifying cardinality in an execution plan
Cardinality - estimated #
of rows returned
Determine correct cardinality using a SELECT
COUNT(*) from each table applying any
WHERE Clause predicates belonging to that
table

Checking cardinality estimates
SELECT /*+ gather_plan_statistics */
p.prod_name, SUM(s.quantity_sold)
WHERE s.prod_id =p.prod_id
GROUP BY p.prod_name ;
SELECT * FROM table (
DBMS_XPLAN.DISPLAY_CURSOR(FORMAT=>'ALLSTATS LAST'));

Compare estimated number of rows (E-Rows) with actual
rows returned (A-Rows)

Extra information you get with ALLSTATS
Starts indicates the number of times that step or operation was done
In this case the SALES table is partitioned and has 28 partitions

Buffers indicates the number of buffers that need to be read for
each step

0Mem - estimated amount of memory needed
1Mem - amount of memory need to perform the operation in 1 pass
Used-Mem - actual amount of memory used and number of passes required

Checking cardinality estimates for Parallel Execution
Note: a lot of the data is zero in
the A-rows column because we
only show last executed cursor
which is the QC. Need to use
ALLSTATS ALL to see info on all
parallel server cursors

DBMS_XPLAN.DISPLAY_CURSOR(FORMAT=>'ALLSTATS ALL'));
Checking cardinality estimates for Parallel Execution

Easiest way to compare the estimated number of rows returned
with actual rows returned
Check cardinality using SQL Monitor

Solutions to incorrect cardinality estimates
Cause Solution
Stale or missing statistics DBMS_STATS
Data Skew Create a histogram
Multiple single column predicates on a table Create a column group using
DBMS_STATS.CREATE_EXTENDED_STATS
Function wrapped column Create statistics on the funct wrapped
column using
DBMS_STATS.CREATE_EXTENDED_STATS
Multiple columns used in a join Create a column group on join columns
using DBMS_STATS.CREATE_EXTENDED_STAT
Complicated expression containing columns
from multiple tables
Use dynamic sampling level 4 or higher

Program Agenda
1
2
3
4
• Cardinality
• Access paths
• Join methods
• Join order
27

Access paths – Getting the data
Access Path Explanation
Full table scan Reads all rows from table & filters out those that do not meet the where clause predicates. Used when
no index, DOP set etc
Table access by Rowid Rowid specifies the datafile & data block containing the row and the location of the row in that block.
Used if rowid supplied by index or in where clause
Index unique scan Only one row will be returned. Used when table contains a UNIQUE or a PRIMARY KEY constraint that
guarantees that only a single row is accessed
Index range scan Accesses adjacent index entries returns ROWID values Used with equality on non-unique indexes or
range predicate on unique indexes (<.>, between etc)
Index skip scan Skips the leading edge (column) of the index & uses the rest Advantageous if there are few distinct
values in the leading column and many distinct values in the non-leading column or columns of the
index
Full index scan Processes all leaf blocks of an index, but only enough branch blocks to find 1st leaf block. Used when all
necessary columns are in index & order by clause matches index structure or if a sort merge join is done
Fast full index scan Scans all blocks in index used to replace a Full Table Scan when all necessary columns are in the index.
Using multi-block IO & can going parallel
Index joins Hash join of several indexes that together contain all the table columns that are referenced in the query.
Won’t eliminate a sort operation
Bitmap indexes Uses a bitmap for key values and a mapping function that converts each bit position to a rowid. Can
efficiently merge indexes that correspond to several conditions in a WHERE clause

Identifying access paths in an execution plan
If the wrong access method is being used check cardinality, join order…
Look in Operation section to see how
an object is being accessed

Access path example 1
Table customers contains 10K rows & has a primary key on cust_id
SELECT country_id, name
FROM customers
WHERE cust_id IN (100,200,100000);
What plan would you expect for this query?
Predicate Information (identified by operation id):
----------------------------------------------------------------------
3 - access("CUST_ID"=100 OR "CUST_ID"=200 OR "CUST_ID"=100000)

FROM customers
WHERE cust_id BETWEEN 100 AND 150;

FROM customers
WHERE country_name = ‘USA’;

Common access path issues
Issue Cause
Uses a table scan instead of index DOP on table but not index, value of MBRC
Picks wrong index Stale or missing statistics
Cost of full index access is cheaper than index
look up followed by table access
Picks index that matches most # of column

Program Agenda
1
2
3
4
• Cardinality
• Access paths
• Join methods
• Join order
34

Join methods
Join Methods Explanation
Nested Loops joins For every row in the outer table, Oracle accesses all the rows in the inner table
Useful when joining small subsets of data and there is an efficient way to access the
second table (index look up)
Hash Joins The smaller of two tables is scan and resulting rows are used to build a hash table
on the join key in memory. The larger table is then scan, join column of the resulting
rows are hashed and the values used to probing the hash table to find the matching
rows. Useful for larger tables & if equality predicate
Sort Merge joins Consists of two steps:
1. Sort join operation: Both the inputs are sorted on the join key.
2. Merge join operation: The sorted lists are merged together.
Useful when the join condition between two tables is an inequality condition

Join types
Join Type Explanation
Inner Joins Returns all rows that satisfy the join condition
Outer Joins Returns all rows that satisfy the join condition and also returns all of the rows from the table
without the (+) for which no rows from the other table satisfy the join condition
Cartesian
Joins
Joins every row from one data source with every row from the other data source, creating
the Cartesian Product of the two sets. Only good if tables are very small. Only choice if
there is no join condition specified in query
Semi-Join Returns a row from the outer table when a matching row exists in the subquery data set.
Typically used when there is an EXISTS or an IN predicate, where we aren’t interested in
returning rows from the subquery but merely checking a match exists
Anti-Join Returns a row from the outer table when a matching row does not exist in the subquery data
set. Typically used when there is a NOT EXISTS or NOT IN predicate, where we aren’t
interested in returning rows from the subquery but merely checking a match doesn’t exists
A B

Identifying join methods in an execution plan
If wrong join type is used check stmt is written correctly & cardinality
estimates
Look in the Operation section to
check the right join type is used

Join method example 1
SELECT e.last_name, e.salary, d.department_name
FROM hr.employees e, hr.departments d
WHERE d.departments_name IN ('Marketing‘,'Sales')
AND e.department_id = d.department_id;
Employees has 107 rows
Departments has 27 rows
Foreign key relationship between Employees and Departments on dept_id
What join method would you expect for this query?

SELECT e.last_name, e.salary, d.department_name
FROM hr.employees e, hr.departments d
WHERE d.departments_name IN ('Marketing‘,'Sales')
AND e.department_id = d.department_id;

SELECT o.customer_id, l.unit_price * l.quantity
FROM oe.orders o, oe.order_items l
WHERE l.order_id = o.order_id;
Orders has 105 rows
Order Items has 665 rows

SELECT o.customer_id, l.unit_price * l.quantity
FROM oe.orders o ,oe.order_items l
WHERE l.order_id = o.order_id;
Orders has 105 rows
Order Items has 665 rows

Join type example 1
SELECT o.order_id, o.order_date ,e.name
FROM oe.orders o , hr.employees e;
Orders has 105 rows
Employees has 107 rows
What join type should be use for this query?

Join type example 1
SELECT o.order_id, o.order_date, e.name
FROM oe.orders o , hr.employees e;

Join type example
SELECT s.quantity_sold
FROM sales s, customers c
WHERE s.cust_id =c.cust_id;
Sales table has 960 Rows
Customer table has 55,500 rows
Customer has a primary key created on cust_id
Sales has a foreign key created on cust_id

Join type example
SELECT s.quantity_sold
FROM sales s, customers c
WHERE s.cust_id =c.cust_id;
No join is needed
Table elimination transformation
Optimizer realizes that the join to
customers tables is redundant as no
columns are selected Presence of
primary –foreign key relationship
means we can remove table

What causes wrong join method to be
selected
Issue Cause
Nested loop selected instead of hash join Cardinality estimate on the left side is
under estimated triggers Nested loop to
be selected
Hash join selected instead of nested loop In case of a hash join the Optimizer
doesn’t taken into consideration the
benefit of caching. If rows on the left
come in a clustered or ordered fashion
so the probe into 2nd table is more
efficient
Cartesian Joins Cardinality underestimation
Adaptive Plans in 12c can address
these problems on the fly by
changing the join method after you
see what data is coming out of the
left hand side of the join

Program Agenda
1
2
3
4
• Cardinality
• Access paths
• Join methods
• Join order
47

Join order
• The order in which the tables are join in a multi table statement
• Ideally start with the table that will eliminate the most rows
• Strongly affected by the access paths available
• Some basic rules
• Joins guaranteed to produce at most one row always go first
• Joins between two row sources that have only one row each
• When outer joins are used the table with the outer join operator must
come after the other table in the predicate
• If view merging is not possible all tables in the view will be joined before
joining to the tables outside the view

Identifying join order in an execution plan
If the join order is not correct, check the statistics, cardinality & access
methods
1
2
3
Want to start with the table that
reduce the result set the most
4
5

It can be hard to determine Join Order for Complex SQL statements but it is easily
visible in the outline data of plan FORMAT=>’TYPICAL +outline’);
SELECT * FROM table(dbms_xplan.display_cursor(format=>’TYPICAL +OUTLINE'));
Finding the join order for complex SQL
The leading hint tells
you the join order

What causes the wrong join order
Causes
Incorrect single table cardinality estimates
Incorrect join cardinality estimates

Program Agenda
1
2
3
4
• Cardinality
• Access paths
• Join methods
• Join order
52

Example SQL Statement
SELECT e1.last_name, e1.job_title, e1.total_comp
FROM (SELECT e.manager_id, e.last_name, j.job_title,
e.salary+(e.salary+e.commission_pct) total_comp
FROM employees e, jobs j, departments d
WHERE d.department_name = 'Sales'
AND e.department_id = d.department_id
AND e.job_id = j.job_id ) e1,
(SELECT e.employee_id, e.salary+(e.salary+e.commission_pct) tc
FROM employees e, departments d
WHERE d.department_name = ‘Sales'
AND e.department_id = d.department_id ) e2
WHERE e1.manager_id = e2.employee_id
AND e1.total_comp >= e2.tc;
Find all the employees who make as much or more than their manager

Is it a good execution plan?
Means no stats gathered strong
indicator this won’t be best
possible plan
1. Is the estimated number of
rows being returned accurate?
2. Are the cardinality
estimates accurate?
3.Are the access
method correct?

Example cont’d execution plan
5. Is the join order correct? Is the table that
eliminates the most rows accessed first?
4. Are the right join methods being used?
1
2
3
4
5

What does the plan tree look like?
TABLE ACCESS
EMPLOYEES
TABLE ACCESS
DEPARTMENT
MERGE JOIN
CARTESIAN
TABLE ACCESS
EMPLOYEES
HASH JOIN
INDEX UNIQUE SCAN –
TABLE ACCESS
DEPARTMENT
NESTED LOOP INDEX UNIQUE SCAN –
TABLE ACCESS JOBS
NESTED LOOP

Solution
2. Cardinalities are correct and
with each join number of rows
reduced
1. Only 1 row is actually returned and the cost is 4
lower now
4. Join methods have
changed to be all NL
3. Access methods
have changed for
some tables
1
2
3
5. The join
order has
changed
5
4

What does the plan tree look like?
TABLE
ACCESS
DEPARTMENT
NESTED LOOP
INDEX UNIQUE SCAN –
TABLE ACCESS
DEPARTMENT
NESTED LOOP
INDEX UNIQUE SCAN -
TABLE ACCESS JOBS
NESTED LOOP
NESTED LOOP
INDEX RANGE SCAN –
TABLE ACCESS
EMPLOYEES
INDEX RANGE SCAN –
TABLE ACCESS
EMPLOYEES

59
Related White Papers
• Explain the Explain Plan
• Understanding Optimizer Statistics
• Best Practices for Gathering Optimizer Statistics
•What to expect from the Optimizer in 19c
•What to expect from the Optimizer in 12c
• What to expect from the Optimizer in 11g
Join the Conversation
https://twitter.com/SQLMaria
https://blogs.oracle.com/optimizer/
https://sqlmaria.com
https://www.facebook.com/SQLMaria

Ground Breakers Romania: Explain the explain_plan

More Related Content

What's hot (20)

Similar to Ground Breakers Romania: Explain the explain_plan (20)

More from Maria Colgan (16)

Recently uploaded (20)

Ground Breakers Romania: Explain the explain_plan

Editor's Notes