home  »  Blogs  »  DevinKnight  »  Enabling Checkpoints in your SSIS Packages

To rate this blog entry please  register or login

Author

DevinKnight DevinKnight (Member since: 10/27/2009)
Devin (MCTS) is a Senior BI consultant at Pragmatic Works Consulting. Previously, he has tech edited the book Professional Microsoft SQL Server 2008 Integration Services and was an author in the book Knight's 24-Hour Trainer: Microsoft SQL Server 2008 Integration Services. Devin has spoken at past conferences like PASS and at several SQL Saturday events. He is a contributing member to the Business Intelligence Special Interest Group (SIG) for PASS as a leader in the SSIS Focus Group. Making his home in Jacksonville, FL, Devin helps run his local users’ group (JSSUG) as a Vice President.

View DevinKnight 's profile

Comments (4)

  • MarkGStacey 1/23/2010 4:35:55 AM by:  MarkGStacey
    There are several things you need to be careful of when creating a package that can resume. I am speaking from experience on packages that I've manually resumed. One of them is the commit size on data flows, if it's 0, then the data will be written as a single batch, and if it fails, then nothing is written. If it is say 5000, and 80000 rows have been written before the Data Flow task fails, then those rows that have been written are still in the destination table. Attempting to rerun the data flow will now insert duplicate records. Devin, I imagine that exactly the same will happen with checkpoints? Or is the engine THAT smart to know where a load is within a data flow? I doubt it.
  • devinknight 1/26/2010 8:41:30 AM by:  devinknight
    Yep you're absolutely right. If partial rows get inserted you could get duplicate data even with Checkpoints.
  • nitya 1/31/2010 3:48:01 PM by:  nitya
    Devin, By wrapping in a transaction, you can avoid duplicates right?
  • devinknight 2/1/2010 7:56:18 AM by:  devinknight
    Yes but one thing to be aware of with transactions is they do not work on all tasks. For example if you have transactions set on a package with a File System Task that moves a file the transaction will not move the file back if the package fails.

Post a comment

Comment (No HTML)  

Type the characters:
 *
 
   

Join Business Intelligence Developer Network for FREE Today!

It's fast, easy and free! Submit articles, get your own blog, ask questions & give answers in the forums, and become a better developer, faster.

enter your email address:

DevinKnight's latest blog posts

  • Using Excel 2007 in SSIS 2005
    3/2/2010
    Many companies are not in a rush to upgrade their SQL Servers because of the enormous cost to upgrade.  This results in the majority of companies still running previous versions of SQL Server (2005, 2000, and even earlier).  Many times as the developer yo...
  • Using Database Transactions across multiple SSIS Tasks
    3/2/2010
    If you experiment at all with transactions that are built into SSIS you will discover that they are highly flawed.  For example, if you have a transaction running on an entire package some tasks may not rollback on a failure.  A file system task is one of...
  • IntelliSense Slow to Refresh
    2/23/2010
    IntelliSense in SQL Server 2008 can sometimes not be very intelligent.  It’s there to help you can sometimes cause more problems than it does solve problems.  Here’s one of those problems cases: Create a table without using the UI.  Just type a basic scri...
  • Free Webinar Series This Week
    2/22/2010
    If you haven’t heard already this week there is a great free webinar series going on that’s meant for beginners.  This series is meant to get you up to speed on many topics like TSQL, DBA Fundamentals, SSIS, SSAS, SSRS, and Performance Tuning.  Oh and did...
  • Development Lifecycle Deployment SSAS, SSRS, SSIS
    2/17/2010
    Many companies have a very rigid development lifecycle for all products or solutions they develop.  Deploying to each of these environments (Development, UAT, and Production) can be a nightmare to maintain.  Luckily there is a great feature in Visual Stud...

Latest community blog posts

  • BradSchacht SQL REPLACE for editing Configuration Tables
    3/10/2010
    Package Configurations in SSIS are key to making your packaged portable across the entire development process.  The problem you being to face with configuration files is the quantity that you collect.  Recently I was working on a project where we had paca...
  • BradSchacht Calculate the Date of the Previous Sunday
    3/10/2010
    There are a number of ways that you can calculate dates using T-SQL.  A common practice is to find the first day of the week which can be accomplished easily by using the following function.select DATEADD(wk, DATEDIFF(wk,0,getdate()), 0)However, you will ...
  • Bevans Back to Basics
    3/10/2010
    Today I figured I go back to basics with this blog since a majority of the visitors to this site are primarily DBA's and Database Guru's. This may turn into a series but for now we will discuss a bit of a feared power of sql server, and that is the fact t...
  • PatrickLeBlanc Using a CTE with a T-SQL Pivot Statement
    3/9/2010
    During a T-SQL class that I was recently teaching I was asked if a PIVOT could be performed using a Common Table Expression (CTE).  In other words, instead of using the method outlined in SQL Server Books Online that uses a derived table, replace the deri...
  • mroman98 Execute a SSIS package from a remote server
    3/9/2010
    Hi ,   I have a package that i need to be able to execute form a remote server....   How can i do that?... i need to have an icon on the desktop so the user can click on it and the package be executed. This is a very simple package where i have s source f...