DiscoverSplunk [Data Fabric Search and Data Stream Processor] 2019 .conf Videos w/ SlidesData Stream Processor: Architecture and SDKs [Splunk Data Fabric Search and Data Stream Processor]
Data Stream Processor: Architecture and SDKs [Splunk Data Fabric Search and Data Stream Processor]

Data Stream Processor: Architecture and SDKs [Splunk Data Fabric Search and Data Stream Processor]

Update: 2019-12-24
Share

Description

Popular stream processing frameworks (such as Apache Spark Streaming, Apache Flink, and Apache Kafka Streams) make stream processing accessible to developers with language bindings typically in Java, Scala, and Python. These frameworks also include some variant of streaming SQL support to further expand the accessibility of large-scale, low-latency, high-throughput stream processing. What's missing is bringing the world of stream processing to the Business Intelligence user. At Splunk we've built a tool called Splunk Data Stream Processor (DSP) to fill this gap. In this session, Max and Sharon will present the design and architecture of DSP. We will compare it with other stream processing frameworks to show you how DSP allows users to visually author and preview stream processing pipelines and instantly deploy them at scale. We will also present our developer SDKs, allowing third-party custom functions to be developed and integrated for data processing. With its high level abstractions for business users and extensible framework for developers, Data Stream Processor makes stream processing accessible to the widest possible audience.


Speaker(s)
Sharon Xie, Sr. Software Engineer, Splunk
Max Feng, Software Engineer, Splunk



Slides PDF link - https://conf.splunk.com/files/2019/slides/DEV1317.pdf?podcast=1577146266


Product: Splunk Data Fabric Search and Data Stream Processor


Track: Developer


Level: Intermediate

Comments 
In Channel
00:00
00:00
x

0.5x

0.8x

1.0x

1.25x

1.5x

2.0x

3.0x

Sleep Timer

Off

End of Episode

5 Minutes

10 Minutes

15 Minutes

30 Minutes

45 Minutes

60 Minutes

120 Minutes

Data Stream Processor: Architecture and SDKs [Splunk Data Fabric Search and Data Stream Processor]

Data Stream Processor: Architecture and SDKs [Splunk Data Fabric Search and Data Stream Processor]

Splunk