Analysing Public Kafka Data from NASA Satellites
📺 Click to view the youtube embed player and accept their cookies.
Session Abstract
This session builds on the foundational OSS technologies of the modern Lakehouse—Apache Kafka, Spark, Unity Catalog and MLFlow—and shows how everyone can analyze supernova data coming from NASA’s satellites and analyze data streams with natural language and plot their own map cosmic events.
Session Description
Experience how cosmic events become streaming data in this tech-focused demo, running on the Databricks Lakehouse. Using foundational OSS technologies (Apache Kafka, Apache Spark™, Unity Catalog, MLflow), we’ll capture and analyze supernova data streams in real time. While this is a pure tech talk with reusable open-source code, you’ll naturally grasp unified lakehouse concepts along the way.