Welcome to another episode of Data Engineering Weekly. Aswin and I select 3 to 4 articles from each edition of Data Engineering Weekly and discuss them from the author’s and our perspectives.

On DEW #129, we selected the following article

DoorDash identifies Five big areas for using Generative AI

Generative AI has taken the industry by storm, and every company is trying to determine what it means to them. DoorDash writes about its discovery of Generative AI and its application to boost its business.

1. The assistance of customers in completing tasks

   
   



2. Better tailored and interactive discovery [Recommendation]

   
   



3. Generation of personalized content and merchandising

   
   



4. Extraction of structured information

   
   



5. Enhancement of employee productivity

   
   

https://doordash.engineering/2023/04/26/doordash-identifies-five-big-areas-for-using-generative-ai/

Mikkel Dengsøe: Europe data salary benchmark 2023

Fascinating findings on Europe’s data salary among various countries. The key findings are

1. German-based roles pay lower.

   
   



2. London and Dublin-based roles have the highest compensations. The Dublin sample is skewed to more senior roles, with 55% of reported salaries being senior, which is more indicative of the sample than jobs in Dublin paying higher than in London.

   
   



3. The top 75% percentile jobs in Amsterdam, London, and Dublin pay nearly 50% more than those in Berlin

   
   

https://medium.com/@mikldd/europe-data-salary-benchmark-2023-b68cea57923d

Trivago: Implementing Data Validation with Great Expectations in Hybrid Environments

The article by Trivago discusses the integration of data validation with Great Expectations. It presents a well-balanced case study that emphasizes the significance of data validation and the necessity for sophisticated statistical validation methods.

https://tech.trivago.com/post/2023-04-25-implementing-data-validation-with-great-expectations-in-hybrid-environments.html

Expedia: How Expedia Reviews Engineering Is Using Event Streams as a Source Of Truth

“Events as a source of truth” is a simple but powerful idea to persist the state of the business entity as a sequence of state-changing events. How to build such a system? Expedia writes about the review stream system to demonstrate how it adopted the event-first approach.

https://medium.com/expedia-group-tech/how-expedia-reviews-engineering-is-using-event-streams-as-a-source-of-truth-d3df616cccd8