I will introduce the “Spark Connect” protocol and share the architecture and usage examples of implementing an in-house managed Spark as a Service using Spark Connect.
DAY 1
16:05-16:35 JST
Seminar Room B
KoJaEn
Streaming
Introduction to "Spark Connect" and Implementation of Managed Spark as a Service
Speaker
Lee Seung / LINE Plus
Data Platform Data Platform Engineering Data Platform Dev
Joined LINE Plus in 2018, where I developed and operated a Kubernetes as a Service platform.
Since 2023, I'm working as a data platform engineer.