blogs.conchango.com

welcome to the conchango blogging site
Welcome to blogs.conchango.com Sign in | Join | Help
in Search

SSIS Junkie

Shifting data in a northern accent

Interested in working at Conchango? Email me

IM me Get alerted when a new blog entry is posted Windows Live Alerts Translate this page

SSIS: Data Profiling Task: Part 3 - Column Null Ratio

In this blog entry I am going to outline the function of the Column Null Ratio profile request in the new Data Profiling Task in SQL Server 2008. BOL states about this profile request:

Reports the percentage of null values in the selected column.

This profile helps you identify problems in your data, such as an unexpectedly high ratio of null values in a column. For example, you profile a Zip Code/Postal Code column and discover an unacceptably high percentage of missing codes.

 

I have tested it out on the [Person].[Contact].[MiddleName] column which looks like this:

image

As you can see, there's a fairly healthy distribution of NULL values in there. Below you can see the configuration of the Data Profiling Task which is checking the [Person].[Contact].[MiddleName] field for NULL values..

image

And here are the results:

image

Its fairly clear to see here how many NULL values there are in the column and what the percentage of rows that contain a NULL value is.

This concludes my brief summary of the Column Null Ratio profile request in the Data Profiling Task that is being introduced with SQL Server Integration Services 2008. For more posts in this series please refer to SSIS: Data Profiling Task: Part 1 - Introduction

-Jamie

 

Disclaimer: The information in this blog post is correct at the time of publication. It may have changed before SQL Server 2008 is released.

Comment Notification

If you would like to receive an email when updates are made to this post, please register here

Subscribe to this post's comments using RSS

Comments

 

SSIS Junkie : SSIS: Data Profiling Task: Part 1 - Introduction said:

March 2, 2008 21:26
 

Pedro Perfeito (PedroCGD) said:

Hi Jamie,

I'm arriving from UK from SQLBits conference... Allan spoke something about data profiling and I started to try it, but do you know how can export an entire report to a document and not each column at a time?

For the data profiling I'm based on SSRS Kimball Project... and it gives me all i need... I'm not convinced on this new feature os SSIS 2008...

Cheers!

Pedro

Portugal

March 3, 2008 00:50
 

jamie.thomson said:

Hi Pedro,

I haven't got that far yet :)

-Jamie

March 3, 2008 00:54
 

Tod means Fox | ETL Subsystem 1: Data Profiling said:

March 18, 2008 11:57
 

SSIS Junkie said:

Back in February and March I wrote a series of blog entries explaining how to use the various profile

April 16, 2008 07:42

Leave a Comment

(required) 
(optional)
(required) 
Submit

This Blog

Syndication

News

Powered by Community Server (Personal Edition), by Telligent Systems