SCD type 2 Testing Strategy | ETL Testing Strategy |Slowly Changing Dimensions Testing|SCD 2
This video demonstrates what is SCD 2 and the scenarios we should test while implementation of SCD 2 during Unit, QA and UAT testing.
Some of the scenarios discussed in the video includes
Column Datatypes and Length
Primary Key
Indexes
Constraints
Audit Columns
Grants
New Records - Insert
Change in existing Source Record
Existing Records Deletion
Max Value limit for Surrogate Key
Long Running Session
Duplicates from Source
Dynamic Lookup
Batch Id
Failure Success Email
Reject on Full Refresh
MD5 Column
Rapid Changing Dimension
SCD 0
Foreign Key
Columns used in Fact Table - Indexed or not
View Exposed for Downstream or not
Source Target Recon
Delete Cascade and Late arriving dimensions
#TechCoach #SCD2
Пікірлер: 20
Wow, thank you man! This is a great educative content! There are very few materials on data engineering on youtube. Thank you for filling up this hole!
Great video! One of the best I’ve come across
@TechCoach
2 жыл бұрын
Thanks a lot buddy :)
Thanks a lot, this video helped me very much
@TechCoach
2 жыл бұрын
I am glad Ashwini, I could help :)
Thank you so much
@TechCoach
2 жыл бұрын
Thanks Omkar :)
Thanks for covering in such detailed manner 👍 if possible share or make video on common testcase template for etl testing 🙋 keep making content like this @techcoach 👏👏
@TechCoach
2 жыл бұрын
Sure Suraj, I will work on them
Thanks a lot Bhai!!!
@TechCoach
2 жыл бұрын
I am glad I could help :)
How to write test cases.plz share video.
Can we merge target_backup with new data in source and then minus it from original target to check scd1 i.e. upsert logic testing??
@TechCoach
2 жыл бұрын
I am not sure If I understand your questions correctly Sachin
Rapid changing dimensions are not included in target and it's not the part for reporting .. Please correct me if I'm wrong
@TechCoach
2 жыл бұрын
Rapid changing dimensions are normalized in order to reduce the data size , you can use the normalized tables for your reporting without any issues. Infact you find the table with static records used for your reports often.
Hi Sir, my source don’t have unique key it contains duplicates, I just have new business_date every day how I can implement scd type 2?
@TechCoach
2 жыл бұрын
Can you please paste the table structure prasad?
@prasadkokane7561
2 жыл бұрын
@@TechCoach I found solution. I am creating temp table with max business_date and from that temp table, loading into DIM table using Merge statement.
Bhai sql queries dedo...scd2 ke all