SSIS INCREMENTAL
-
Sunday, March 04, 2012 3:25 PM
Dear All ,
I am working on banking project , i have develioped SSIS PACKAGE to laoding a data from ORACLE to SQL SERVER 2008 through SSIS .
data size is 100000 rows in many table ,
which is traking much time for loading from oracle to SQL SERVER 2008,
plaese suggest some best way for the same and also suggest how can i load only incremental data daily by daily to my staging database .
regards,
Vipin jha
All Replies
-
Sunday, March 04, 2012 6:13 PMModeratoris there a last modified date or a (business) key in your source data?
Please mark the post as answered if it answers your question | My SSIS Blog: http://microsoft-ssis.blogspot.com | Twitter
-
Sunday, March 04, 2012 9:52 PMModerator
Did you read these links about Incremental Load:
http://sqlblog.com/blogs/andy_leonard/archive/2012/02/03/1631.aspx
http://sql-bi-dev.blogspot.co.nz/2010/11/incremental-load-using-ssis-package.html
-
Monday, March 05, 2012 12:14 AM
the fastes way to learn on what and how to set things and see multiple scenario is to watch this presentation at this link
about min 32 it will start talking about scenarios that you are looking for
good luck
Sincerely SH -- MCITP 2008, MCTS 2008 & 2005 -- Please kindly mark the post(s) that answered your question and/or vote for the post(s).
-
Monday, March 05, 2012 12:21 AM
http://sqlblog.com/blogs/andy_leonard/archive/2012/02/03/1631.aspx
in the link it uses SPLIT CONDITION , most cases i dont like it becasue
1- my scenarios are different
2- the technique is kind of old school SQL , i prefer to use CHECKSUM or HASHBYTES in SSIS , way faster in most cases.
BUT you must know why and how to use them, and how to captuer duplicates reocds if not captured, its tricky
good luck
Sincerely SH -- MCITP 2008, MCTS 2008 & 2005 -- Please kindly mark the post(s) that answered your question and/or vote for the post(s).
- Edited by Nik - Shahriar Nikkhah Monday, March 05, 2012 12:22 AM
-
Monday, March 05, 2012 6:53 AM
ues there are LCHG_TIME AND RCRE_TIME DATE FIELD IS THERE IN EVERY TABLE
Regards,
Vipin jha
-
Monday, March 05, 2012 2:05 PM
ues there are LCHG_TIME AND RCRE_TIME DATE FIELD IS THERE IN EVERY TABLE
Regards,
Vipin jha
is this in ORACLE ?Sincerely SH -- MCITP 2008, MCTS 2008 & 2005 -- Please kindly mark the post(s) that answered your question and/or vote for the post(s).
-
Tuesday, March 06, 2012 3:28 PM
yes this is in oracle .....
regards,
Vipin jha

