DiscoverTech on the RocksStream processing, LSMs and leaky abstractions with Chris Riccomini
Stream processing, LSMs and leaky abstractions with Chris Riccomini

Stream processing, LSMs and leaky abstractions with Chris Riccomini

Update: 2024-08-23
Share

Description

In this episode, we  chat with Chris Riccomini about the evolution of stream processing and the challenges in building applications on streaming systems. We also chat about leaky abstractions, good and bad API designs, what Chris loves and hates about Rust and finally about his exciting new project that involves object storage and LSMs.
 
Connect with Chris at:
LinkedIn
X
Blog
Materialized View Newsletter - His newsletter
The missing README - His book
SlateDB - His latest OSS Project

Chapters
00:00 Introduction and Background

04:05 The State of Stream Processing Today

08:53 The Limitations of SQL in Streaming Systems

14:00 Prioritizing the Developer Experience in Stream Processing

18:15   Improving the Usability of Streaming Systems

27:54 The Potential of State Machine Programming in Complex Systems

32:41 The Power of Rust: Compiling and Language Bindings

34:06 The Shift from Sidecar to Embedded Libraries Driven by Rust

35:49 Building an LSM on Object Storage: Cost-Effective State Management

39:47 The Unbundling and Composable Nature of Databases

47:30 The Future of Data Systems: More Companies and Focus on Metadata


Click here to view the episode transcript.


Comments 
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Stream processing, LSMs and leaky abstractions with Chris Riccomini

Stream processing, LSMs and leaky abstractions with Chris Riccomini

Kostas, Nitay