gotchasqlModerate
Why does SQL Server refuse to update these statistics with anything but fullscan?
Viewed 0 times
whytheserefuseupdatesqlwithanythingbutfullscanstatistics
Problem
I noticed a relatively long running (20 min+) auto update statistics operation in a daily datawarehouse build. The table involved is
This is running on Microsoft SQL Server 2012 (SP1) - 11.0.3513.0 (X64) so writable columnstore indexes are not available.
The table contains data for two distinct Market keys. The build switches out the partition for a specific MarketKey to a staging table, disables the columnstore index, performs necessary writes, rebuilds the columnstore, then switches it back in.
The execution plan for the update statistics shows that it pulls out all rows from the table, sorts them, gets the estimated number of rows badly wrong and spills to
Running
Shows
If I explicitly try and reduce the sample size of that index's statistics to that used by the others with
The query runs for 20 minutes+ again and the execution plan shows that it is processing all rows not the 897,667 sample requested.
The statistics generated at the end of all this aren't very interesting and definitely don't seem to warrant the time spent on a full scan.
```
Statistics for INDEX 'PK_factWebAnalytics'.
-----
CREATE TABLE [dbo].[factWebAnalytics](
[WebAnalyticsId] [bigint] IDENTITY(1,1) NOT NULL,
[MarketKey] [int] NOT NULL CONSTRAINT [DF_factWebAnalytics_MarketKey] DEFAULT ((-1)),
/*Other columns removed*/
CONSTRAINT [PK_factWebAnalytics] PRIMARY KEY CLUSTERED
(
[MarketKey] ASC,
[WebAnalyticsId] ASC
)WITH (PAD_INDEX = OFF, STATISTICS_NORECOMPUTE = OFF, IGNORE_DUP_KEY = OFF, ALLOW_ROW_LOCKS = ON, ALLOW_PAGE_LOCKS = ON) ON [MarketKeyPS]([MarketKey])
) ON [MarketKeyPS]([MarketKey])This is running on Microsoft SQL Server 2012 (SP1) - 11.0.3513.0 (X64) so writable columnstore indexes are not available.
The table contains data for two distinct Market keys. The build switches out the partition for a specific MarketKey to a staging table, disables the columnstore index, performs necessary writes, rebuilds the columnstore, then switches it back in.
The execution plan for the update statistics shows that it pulls out all rows from the table, sorts them, gets the estimated number of rows badly wrong and spills to
tempdb with spill level 2.Running
SELECT [s].[name] AS "Statistic",
[sp].*
FROM [sys].[stats] AS [s]
OUTER APPLY sys.dm_db_stats_properties ([s].[object_id], [s].[stats_id]) AS [sp]
WHERE [s].[object_id] = OBJECT_ID(N'[dbo].[factWebAnalytics]');Shows
If I explicitly try and reduce the sample size of that index's statistics to that used by the others with
UPDATE STATISTICS [dbo].[factWebAnalytics] [PK_factWebAnalytics] WITH SAMPLE 897667 ROWSThe query runs for 20 minutes+ again and the execution plan shows that it is processing all rows not the 897,667 sample requested.
The statistics generated at the end of all this aren't very interesting and definitely don't seem to warrant the time spent on a full scan.
```
Statistics for INDEX 'PK_factWebAnalytics'.
-----
Solution
The first thing I would try is updating the SQL Server instance from the SP1 CU16 with QFE that you have right now, to SP3 CU1 (current 2012 build) then retesting to see if the behaviour is the same.
For example:
FIX: UPDATE STATISTICS performs incorrect sampling and processing for a table with columnstore index in SQL Server
...first released in SP2 CU2 may be relevant.
That said, I'm not sure if 2012 columnstore supported tablesample, required for sampled statistics. I'll update this answer once a repro is available in the question.
For example:
FIX: UPDATE STATISTICS performs incorrect sampling and processing for a table with columnstore index in SQL Server
...first released in SP2 CU2 may be relevant.
That said, I'm not sure if 2012 columnstore supported tablesample, required for sampled statistics. I'll update this answer once a repro is available in the question.
Context
StackExchange Database Administrators Q#126977, answer score: 10
Revisions (0)
No revisions yet.