DiscoverMLOps.communityRAG Quality Starts with Data Quality // Adam Kamor // #262
RAG Quality Starts with Data Quality // Adam Kamor // #262

RAG Quality Starts with Data Quality // Adam Kamor // #262

Update: 2024-09-20
Share

Description

Adam Kamor is the Co-founder of Tonic, a company that specializes in creating mock data that preserves secure datasets.



RAG Quality Starts with Data Quality // MLOps Podcast #262 with Adam Kamor, Co-Founder & Head of Engineering of Tonic.ai.

// Abstract
Dive into what makes Retrieval-Augmented Generation (RAG) systems tick—and it all starts with the data. We’ll be talking with an expert in the field who knows exactly how to transform messy, unstructured enterprise data into high-quality fuel for RAG systems.

Expect to learn the essentials of data prep, uncover the common challenges that can derail even the best-laid plans, and discover some insider tips on how to boost your RAG system’s performance. We’ll also touch on the critical aspects of data privacy and governance, ensuring your data stays secure while maximizing its utility.

If you’re aiming to get the most out of your RAG systems or just curious about the behind-the-scenes work that makes them effective, this episode is packed with insights that can help you level up your game.

// Bio
Adam Kamor, PhD, is the Co-founder and Head of Engineering of Tonic.ai. Since completing his PhD in Physics at Georgia Tech, Adam has committed himself to enabling the work of others through the programs he develops. In his roles at Microsoft and Kabbage, he handled UI design and led the development of new features to anticipate customer needs. At Tableau, he played a role in developing the platform’s analytics/calculation capabilities. As a founder of Tonic.ai, he is leading the development of unstructured data solutions that are transforming the work of fellow developers, analysts, and data engineers alike.

// MLOps Jobs board
https://mlops.pallet.xyz/jobs

// MLOps Swag/Merch
https://mlops-community.myshopify.com/

// Related Links
Website: https://www.tonic.ai
Various topics about RAG and LLM security are available on Tonic.ai's blogs: https://www.tonic.ai/blog
https://www.tonic.ai/blog/how-to-prevent-data-leakage-in-your-ai-applications-with-tonic-textual-and-snowpark-container-services
https://www.tonic.ai/blog/rag-evaluation-series-validating-the-rag-performance-of-the-openais-rag-assistant-vs-googles-vertex-search-and-conversation
https://www.youtube.com/watch?v=5xdyt4oRONU
https://www.tonic.ai/blog/what-is-retrieval-augmented-generation-the-benefits-of-implementing-rag-in-using-llms

--------------- ✌️Connect With Us ✌️ -------------
Join our slack community: https://go.mlops.community/slack
Follow us on Twitter: @mlopscommunity
Sign up for the next meetup: https://go.mlops.community/register
Catch all episodes, blogs, newsletters, and more: https://mlops.community/

Connect with Demetrios on LinkedIn: https://www.linkedin.com/in/dpbrinkm/
Connect with Adam on LinkedIn: https://www.linkedin.com/in/adam-kamor-85720b48/

Timestamps:
[00:00 ] Adam's preferred coffee
[00:24 ] Takeaways
[00:59 ] Huge shout out to Tonic.ai for supporting the community!
[01:03 ] Please like, share, leave a review, and subscribe to our MLOps channels!
[01:18 ] Naming a product
[03:38 ] Tonic Textual
[08:00 ] Managing PII and Data Safety
[10:16 ] Chunking strategies for context
[14:19 ] Data prep for RAG
[17:20 ] Data quality in AI systems
[20:58 ] Data integrity in PDFs
[27:12 ] Ensuring chatbot data freshness
[33:02 ] Managed PostgreSQL and Vector DB
[34:49 ] RBAC database vs file access
[37:35 ] Slack AI data leakage solutions
[42:26 ] Hot swapping
[46:06 ] LLM security concerns
[47:03 ] Privacy management best practices
[49:02 ] Chatbot design patterns
[50:39 ] RAG growth and impact
[52:40 ] Retrieval Evaluation best practices
[59:20 ] Wrap up

Comments 
In Channel
loading
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

RAG Quality Starts with Data Quality // Adam Kamor // #262

RAG Quality Starts with Data Quality // Adam Kamor // #262

Demetrios Brinkmann