DiscoverAgile Data N’ InfoUnion two or more tables together automatically, AgileData Engineering Pattern #2 - Episode #68
Union two or more tables together automatically, AgileData Engineering Pattern #2 - Episode #68

Union two or more tables together automatically, AgileData Engineering Pattern #2 - Episode #68

Update: 2025-07-03
Share

Description

Join Shane Gibson and Nigel Vining as they describe and discuss the AgileData Engineering Pattern of Unioning two or more tables together automatically.


 


The Automated Table Unioning pattern automatically combines two or more tables by intelligently looking up column names and data types to generate safe SQL under the covers. It supports disparate data sources, such as those from multiple publishers in a data clean room, and creates a view or incrementally loads the unified data into a physical table while tracking load watermarks to prevent duplicates.


 


An AgileData Engineering Pattern is a repeatable, proven approach for solving a common data engineering challenge in a simple, consistent, and scalable way, designed to reduce rework, speed up delivery, and embed quality by default.


 


 


If you just want to talk about making magic happen with agile and data you can connect with Shane @shagility on LinkedIn.


 


Subscribe: Apple Podcast | Spotify | Google Podcast  | Amazon Audible | TuneIn | iHeartRadio | PlayerFM | Listen Notes | PodchaserDeezer | Podcast Addict








Buy the Green Book now!





 


Simply Magical Data Ways of Working

Comments 
loading
In Channel
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Union two or more tables together automatically, AgileData Engineering Pattern #2 - Episode #68

Union two or more tables together automatically, AgileData Engineering Pattern #2 - Episode #68

AgileData