How to Do Data Engineering, with Samit Korgaonkar (Head of Engineering for Enterprise Data)
Description
In this episode of Data Analytics Chat, we explore how to do data engineering.
Data engineering has become crucial for companies as it enables efficient data management, supports advanced analytics, ensures compliance, and drives data-driven decision-making. It is important for businesses to transform their raw data into valuable insights that inform strategic decisions.
Samit Korgaonkar, Head of Engineering for Enterprise Data at Google, the global technology giant, joins us.
In this episode, we will learn:
00:00 Introduction to Data Analytics Chat
00:32 Meet Sumit Korgaonkar: Head of Engineering for Enterprise Data at Google
01:55 The Evolution and Challenges of Data Management
07:38 The Role and Importance of Data Engineering
20:33 Key Components of a Successful Data Engineering Framework
24:17 Designing and Maintaining Robust Data Pipelines
28:31 Choosing the Right Tools for Your Project
30:21 Ensuring Data Quality and Integrity
34:08 Essential Tools for Data Engineering
36:06 Scaling Data Infrastructure
38:49 Compliance and Security in Data Engineering
40:29 Delivering Business Value Through Data Engineering
42:33 Emerging Trends in Data Engineering
46:23 Key Skills for Aspiring Data Engineers
50:22 The Evolving Role of Data Engineers
54:04 Conclusion and Final Thoughts
Thank you for listening!