DiscoverRecsperts - Recommender Systems Experts#7: Behavioral Testing with RecList for Recommenders with Jacopo Tagliabue
#7: Behavioral Testing with RecList for Recommenders with Jacopo Tagliabue

#7: Behavioral Testing with RecList for Recommenders with Jacopo Tagliabue

Update: 2022-07-07
Share

Description

In episode number seven, we meet Jacopo Tagliabue and discuss behavioral testing for recommender systems and experiences from ecommerce. Before Jacopo became the director of artificial intelligence at Coveo, he had founded tooso, which was later acquired by Coveo. Jacopo holds a PhD in cognitive intelligence and made many contributions to conferences like SIGIR, WWW, or RecSys. In addition, he serves as adjunct professor at NYU.

In this episode we introduce behavioral testing for recommender systems and the corresponding framework RecList that was created by Jacopo and his co-authors. Behavioral testing goes beyond pure retrieval accuracy metrics and tries to uncover unintended behavior of recommender models. RecList is an adaption of CheckList that applies behavioral testing to NLP and which was proposed by Microsoft some time ago. RecList comes with an open-source framework with ready set datasets for different recommender use-cases like similar, sequence-based and complementary item recommendations. Furthermore, it offers some sample tests to make it easier for newcomers to get started with behavioral testing. We also briefly touch on the upcoming CIKM data challenge that is going to focus on the evaluation of recommender systems.

In the end of this episode Jacopo also shares his insights from years of building and using diverse ML Ops tools and talk about what he refers to as the "post-modern stack".

Enjoy this enriching episode of RECSPERTS - Recommender Systems Experts.

Links from the Episode:


Papers:


General Links:

Comments 
loading
In Channel
loading
00:00
00:00
1.0x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

#7: Behavioral Testing with RecList for Recommenders with Jacopo Tagliabue

#7: Behavioral Testing with RecList for Recommenders with Jacopo Tagliabue

Marcel Kurovski